-- Logs begin at Thu 2022-07-21 03:37:40 UTC, end at Thu 2022-07-21 06:03:45 UTC. -- Jul 21 04:04:00.369322 dv-cinder-822822-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 04:04:00.376454 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 04:04:00 2022] *** Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: nodename: dv-cinder-822822-6-iscsi Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: machine: x86_64 Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: clock source: unix Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: pcre jit disabled Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: detected number of CPU cores: 4 Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: current working directory: / Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: detected binary path: /usr/bin/uwsgi-core Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: your processes number limit is 47680 Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: your memory page size is 4096 bytes Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: detected max file descriptor number: 2048 Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: lock engine: pthread robust mutexes Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: thunder lock: enabled Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 04:04:00.380246 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 04:04:00.423710 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: Python main interpreter initialized at 0x55b849e859c0 Jul 21 04:04:00.423710 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: python threads support enabled Jul 21 04:04:00.423710 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: your server socket listen backlog is limited to 100 connections Jul 21 04:04:00.423710 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: your mercy for graceful operations on workers is 90 seconds Jul 21 04:04:00.424046 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 04:04:00.424130 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: *** Operational MODE: preforking *** Jul 21 04:04:00.424392 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: *** uWSGI is running in multiple interpreter mode *** Jul 21 04:04:00.424392 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: spawned uWSGI master process (pid: 80176) Jul 21 04:04:00.424590 dv-cinder-822822-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 21 04:04:00.425158 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: spawned uWSGI worker 1 (pid: 80181, cores: 1) Jul 21 04:04:00.428861 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: spawned uWSGI worker 2 (pid: 80182, cores: 1) Jul 21 04:04:00.428861 dv-cinder-822822-6-iscsi devstack@keystone.service[80176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 04:04:05.861728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:04:05.861728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: from cryptography.utils import int_from_bytes Jul 21 04:04:05.862527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:04:05.862527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: from cryptography.utils import int_from_bytes Jul 21 04:04:05.862985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:04:05.862985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jul 21 04:04:05.863441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:04:05.863441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jul 21 04:04:05.912410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 04:04:05.912643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 04:04:05.912901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] command line args: [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 04:04:05.913204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 04:04:05.913403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 04:04:05.913497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ================================================================================ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 04:04:05.913611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 04:04:05.913715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] admin_token = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.913818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] command line args: [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 04:04:05.913947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config_dir = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.914089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 04:04:05.914192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.914271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ================================================================================ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 04:04:05.914379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config_source = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.914511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.914592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] debug = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.914758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_dir = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.914839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_source = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] debug = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.915963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_config_append = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_config_append = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_dir = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.916980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_dir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.917892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.918887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.919994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.920103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.920238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.920359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.920481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.920616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.920755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.920921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.921289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.921414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.921509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] publish_errors = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.921589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] publish_errors = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.921691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.921822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.921910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] standard_threads = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.922966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] standard_threads = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_journal = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_json = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_journal = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_stderr = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.923956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_json = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.924037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_syslog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.924111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_stderr = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.924243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_syslog = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.924323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.924478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:04:05.924564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.924732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.924844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.924999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.925971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.926938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.927024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.927173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.927254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.927409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.927489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.928152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.928267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.928426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.928613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.928720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.928919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.929904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.930896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931134 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.931987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.932943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.933975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.934894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.935936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.936979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.937951 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938498 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.938958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.939968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.940909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.941874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942498 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.942968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.943048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.943204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.943302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.944970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.945939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.946960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.947883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.948814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.949953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.external = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950490 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.950996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.password = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.external = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.token = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.951935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.password = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.token = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.952904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.953859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.954973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.955952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.956973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.957953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.958939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.959948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960030 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.960955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961891 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.961974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.962127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.962219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.962477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.962558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.962719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.962834 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.962948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.963989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.964143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.964224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.964391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.964480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.964639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.964719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.964916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.965956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.966894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.967851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.968975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.969923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.970955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.971893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.972864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973718 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.973959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.974040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.974195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.974277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.974427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.974511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.975207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.975332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.975462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.975706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.975814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.975930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.976922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.977962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.978917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.979851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.980987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.981930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.982979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.983927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.984889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.985864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.986970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.987949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.988944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.989096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.989178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.989344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.989547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.989633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.989789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.989871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.990045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.990128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.990846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.990978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.991922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.992935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.993843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.994957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.995921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.996915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.997968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.998935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:05.999879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.000856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.001955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.002038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.002189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.002272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.002359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 04:04:06.002440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.002664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.002901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.003147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.003389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:04:06.003563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 04:04:06.033097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.033326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.033553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.034252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.034486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.034713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.042351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.043657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.070449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.070673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.071805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.072044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.213829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.216019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.263187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.263423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.266580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.266818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.328577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.328811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.328923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.329922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.354742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.354875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.354972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.355942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.356070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.356164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.367988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.368189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.380568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.380797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.381495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.381634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.381738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.381816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.381947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.382043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.382169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.382254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.382385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.382470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.382597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.382811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:04:06.399481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.399694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:04:06.399835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.400033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.400134 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:04:06.400240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:04:06.400372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.400508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.400685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:04:06.400778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.400881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.401055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.401139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.401310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.401393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.401609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.412343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.412620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.412747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.412914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.413047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.413198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.413315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.413598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.421328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.421710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.424567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.424859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.425015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.425254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.425340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.425540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.425628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.425825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.425943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.426086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.426232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.426355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.426498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.426631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.426773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.426902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.427049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.427172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.427321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.427438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.427596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.428405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.454997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.455396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.456588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.456888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.457040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.457319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.462137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.462413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.462651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.462741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.462931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.463214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.469923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.470156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.470481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.470763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.474766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.475048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.475326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.475411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.475603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.475689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.475874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.475959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.476146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.476231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.476413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.476500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.476676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.476762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.477033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.477304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.496088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.496365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.496639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.496949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.500861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.501604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.504579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.504893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.505264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.505558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.511519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.511891 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.515175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.515590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.518954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.519256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.519340 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.519553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.519638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.519848 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.519934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.520126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.520215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.520406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.520492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.520694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.539628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.540010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.540094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.540285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.540383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.540559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.540644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.540930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.548484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.548745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.550213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.550461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.550557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.550736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.554321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.554506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.554595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.554788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.554874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.555071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.555166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.555357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.555442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.555692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.569807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.570087 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.570370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.570661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.570943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.571232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.571509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.572640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.572958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.573250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.573538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.573817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.574101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.574375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.590745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.593570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.594067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.596850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.597405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.599013 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.600194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.600770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.601077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.601366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.601856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.603487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.603767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.604051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.608859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.610481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.611392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.613014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.613732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.614026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.614312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.614602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.617117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.617405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.617687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.617960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.624659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.624978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.625268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.627093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.627378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.627658 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.633767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.634048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.634333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.634611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.634886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.635164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.635443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.635726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.636005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.636271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:04:06.636356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.636540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.636626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.636802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.636910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.637092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.637189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.637361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.637446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.637639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.637919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.638186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.638468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.638738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.639006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.639264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.639524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.639790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:04:06.675737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b849e859c0 pid: 80182 (default app) Jul 21 04:04:06.677396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b849e859c0 pid: 80181 (default app) Jul 21 04:04:06.679738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac5412-0b66-4fcb-bbcd-f85fffe867b5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:06.680031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac5412-0b66-4fcb-bbcd-f85fffe867b5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:06.680315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac5412-0b66-4fcb-bbcd-f85fffe867b5 None None] PATH_INFO: `/v3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:06.684523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Thu Jul 21 04:04:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:14.407667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205aa28-82ad-4524-8ac0-27f3826cb455 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.408233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205aa28-82ad-4524-8ac0-27f3826cb455 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.408233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205aa28-82ad-4524-8ac0-27f3826cb455 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.413321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:14.418794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.419181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.419351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.487071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: INFO dbcounter [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] Registered counter for database keystone Jul 21 04:04:14.508506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG oslo_db.sqlalchemy.engines [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 04:04:14.514871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writer thread running {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 04:04:14.692200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG passlib.handlers.bcrypt [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80182) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 04:04:14.692620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG passlib.handlers.bcrypt [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80182) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 04:04:14.754023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:14.755626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:14.879800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 21 04:04:15.085504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205aa28-82ad-4524-8ac0-27f3826cb455 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.156412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: INFO dbcounter [None req-4205aa28-82ad-4524-8ac0-27f3826cb455 None None] Registered counter for database keystone Jul 21 04:04:15.175228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG oslo_db.sqlalchemy.engines [None req-4205aa28-82ad-4524-8ac0-27f3826cb455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 04:04:15.182315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writer thread running {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 04:04:15.301150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205aa28-82ad-4524-8ac0-27f3826cb455 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.305991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636fb93-ebd3-4d64-bbfa-c599bd64accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.306651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636fb93-ebd3-4d64-bbfa-c599bd64accc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.306940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636fb93-ebd3-4d64-bbfa-c599bd64accc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.307223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636fb93-ebd3-4d64-bbfa-c599bd64accc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.315344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636fb93-ebd3-4d64-bbfa-c599bd64accc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.368785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e636fb93-ebd3-4d64-bbfa-c599bd64accc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 04:04:15.369096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636fb93-ebd3-4d64-bbfa-c599bd64accc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.378584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 04:04:15.384666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.399118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8eae-7d7f-453f-ae2d-19a08e64bd78 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.403474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f19d4a-17ce-44ad-b776-bb68b55e2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.404604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19d4a-17ce-44ad-b776-bb68b55e2d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.404928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19d4a-17ce-44ad-b776-bb68b55e2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.405212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f19d4a-17ce-44ad-b776-bb68b55e2d06 admin admin] PATH_INFO: `/v3/projects/7d6dae06458e40f5a42cb100a613e196` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.406679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f19d4a-17ce-44ad-b776-bb68b55e2d06 admin admin] RBAC: Authorizing `identity:get_project(project_id=7d6dae06458e40f5a42cb100a613e196)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.460631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING keystone.common.rbac_enforcer.enforcer [None req-29f19d4a-17ce-44ad-b776-bb68b55e2d06 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 04:04:15.461218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f19d4a-17ce-44ad-b776-bb68b55e2d06 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.465498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/projects/7d6dae06458e40f5a42cb100a613e196 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:17.476282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f494b-b893-4baa-91f8-fa97b5e2a233 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:17.476856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f494b-b893-4baa-91f8-fa97b5e2a233 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:17.476856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f494b-b893-4baa-91f8-fa97b5e2a233 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:17.481780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:17.487211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a058b2-1cc8-4817-a4a5-d32c630c4d9d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:17.487590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a058b2-1cc8-4817-a4a5-d32c630c4d9d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:17.487778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a058b2-1cc8-4817-a4a5-d32c630c4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:17.506854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-83a058b2-1cc8-4817-a4a5-d32c630c4d9d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:17.508360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-83a058b2-1cc8-4817-a4a5-d32c630c4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:17.516107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 04:04:17.539753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f494b-b893-4baa-91f8-fa97b5e2a233 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:17.551557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f494b-b893-4baa-91f8-fa97b5e2a233 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:17.555767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503dbe-29e7-4d69-84f3-d9440e2e31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:17.556395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503dbe-29e7-4d69-84f3-d9440e2e31ae admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:17.556680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503dbe-29e7-4d69-84f3-d9440e2e31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:17.556995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503dbe-29e7-4d69-84f3-d9440e2e31ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:17.564520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85503dbe-29e7-4d69-84f3-d9440e2e31ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:17.566326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85503dbe-29e7-4d69-84f3-d9440e2e31ae admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:17.575075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Jul 21 04:04:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:04:17.580242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a058b2-1cc8-4817-a4a5-d32c630c4d9d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:17.590133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a058b2-1cc8-4817-a4a5-d32c630c4d9d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:17.594435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542ebb-3f59-4772-a3d8-5fa100740d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:17.595289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542ebb-3f59-4772-a3d8-5fa100740d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:17.595576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542ebb-3f59-4772-a3d8-5fa100740d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:17.595856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542ebb-3f59-4772-a3d8-5fa100740d78 admin admin] PATH_INFO: `/v3/users/76d529df90494c78a07e9c839c744d19` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:17.597257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542ebb-3f59-4772-a3d8-5fa100740d78 admin admin] RBAC: Authorizing `identity:get_user(user_id=76d529df90494c78a07e9c839c744d19)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:17.599078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542ebb-3f59-4772-a3d8-5fa100740d78 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:17.601744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Thu Jul 21 04:04:17 2022] GET /identity/v3/users/76d529df90494c78a07e9c839c744d19 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:19.701346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65fce-16e3-43d4-9592-d36b6523f694 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.701845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65fce-16e3-43d4-9592-d36b6523f694 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.701934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65fce-16e3-43d4-9592-d36b6523f694 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.703356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:19.708604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4341eb-22d6-465d-9f6d-51fbd35dd966 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.709042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4341eb-22d6-465d-9f6d-51fbd35dd966 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.709424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4341eb-22d6-465d-9f6d-51fbd35dd966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.726071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bd4341eb-22d6-465d-9f6d-51fbd35dd966 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:19.726688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c518-9973-4db2-97c1-4d43555c2903 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.726987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c518-9973-4db2-97c1-4d43555c2903 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.727261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bd4341eb-22d6-465d-9f6d-51fbd35dd966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:19.727358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c518-9973-4db2-97c1-4d43555c2903 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.728602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:19.733802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.734094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.734382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.779830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 04:04:19.780243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 04:04:19.808836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:19.826237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:19.827805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:19.832113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4341eb-22d6-465d-9f6d-51fbd35dd966 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.856030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:19.929484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:19.936238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4341eb-22d6-465d-9f6d-51fbd35dd966 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:19.951041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.969330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:19.970128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.970418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.970704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.982483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:19.994811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:19.995910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:19.996946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:20.001792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.050899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fd8b9-6a04-4e4e-9364-eb06a5fd2113 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.053762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.083651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.088160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.089098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.089396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.089680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.102944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7a979-439a-44e4-94fe-0262d359afa1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.137162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.137838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.138127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.138409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.139161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:20.139474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.140953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.153780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:20.157321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.158961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.159330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.256724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:20.260352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a74aa-27fd-43ec-8bf0-a918cee78f54 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.262967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.265805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.296736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.297664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.297954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.298237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] PATH_INFO: `/v3/users/76d529df90494c78a07e9c839c744d19` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.299456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] RBAC: Authorizing `identity:get_user(user_id=76d529df90494c78a07e9c839c744d19)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.300976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.303787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/users/76d529df90494c78a07e9c839c744d19 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:20.311035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.332428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.367441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ca3a7-0b31-4c8f-89d7-918ba71560a2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.403460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.403460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.403460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.403460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.423788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.423980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1741ac-652e-4c86-bab9-227f11f221f0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.425329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:04:20.448181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:20.449120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:20.450018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:04:20.450018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:04:20.450018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:20.450018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:20.450018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:20.457448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.465115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.465921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.466208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.466567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.467772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.469283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.471368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:20.477308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.526634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.576572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.581817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4858-c57f-4576-96ac-4628384e16fd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.596898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daabbbc-57c9-4853-9ccf-478acce50461 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.625240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c99e4-c934-43ad-baa1-2492b8098e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.625908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c99e4-c934-43ad-baa1-2492b8098e6c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.626193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c99e4-c934-43ad-baa1-2492b8098e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.626476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c99e4-c934-43ad-baa1-2492b8098e6c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.627487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c99e4-c934-43ad-baa1-2492b8098e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:20.627815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c99e4-c934-43ad-baa1-2492b8098e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.629252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c99e4-c934-43ad-baa1-2492b8098e6c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.634683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fecd2-d2c8-40f7-a21a-c9df8ac495de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.635447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fecd2-d2c8-40f7-a21a-c9df8ac495de None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.635862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fecd2-d2c8-40f7-a21a-c9df8ac495de None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.636153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fecd2-d2c8-40f7-a21a-c9df8ac495de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.637041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fecd2-d2c8-40f7-a21a-c9df8ac495de None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.domain.id=default, user.id=76d529df90494c78a07e9c839c744d19) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:20.637367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fecd2-d2c8-40f7-a21a-c9df8ac495de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.638827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fecd2-d2c8-40f7-a21a-c9df8ac495de None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.648793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/role_assignments?user.id=76d529df90494c78a07e9c839c744d19&scope.domain.id=default&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 233 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:20.649427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:23.262350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9320ca-2b25-4660-a831-c3a9270c1cfb None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.262885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9320ca-2b25-4660-a831-c3a9270c1cfb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.263043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9320ca-2b25-4660-a831-c3a9270c1cfb None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.264321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:23.266815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d3c85-d0d7-443f-9aa5-165c6c214fa9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.267715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d3c85-d0d7-443f-9aa5-165c6c214fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.268194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d3c85-d0d7-443f-9aa5-165c6c214fa9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.269931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 11/23] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:23.270347 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce5b6-ef9f-4df5-ad7b-5780577233ea None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.270889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce5b6-ef9f-4df5-ad7b-5780577233ea None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.271376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce5b6-ef9f-4df5-ad7b-5780577233ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.284264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e01e8-a854-42b2-966e-ff1532f2f2a3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.285337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e01e8-a854-42b2-966e-ff1532f2f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.286159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e01e8-a854-42b2-966e-ff1532f2f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.297854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a98ce5b6-ef9f-4df5-ad7b-5780577233ea None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:23.299090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a98ce5b6-ef9f-4df5-ad7b-5780577233ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:23.318020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-049e01e8-a854-42b2-966e-ff1532f2f2a3 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:23.319626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-049e01e8-a854-42b2-966e-ff1532f2f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:23.410340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 13/24] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:23.431209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 12/25] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:23.454285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce5b6-ef9f-4df5-ad7b-5780577233ea None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:23.465151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e01e8-a854-42b2-966e-ff1532f2f2a3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:23.536773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:23.602746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:23.635369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e01e8-a854-42b2-966e-ff1532f2f2a3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:23.653682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce5b6-ef9f-4df5-ad7b-5780577233ea None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:23.690632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291e2bc-e567-40a6-b397-b2cae3d40d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:23.691432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291e2bc-e567-40a6-b397-b2cae3d40d0b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.691717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291e2bc-e567-40a6-b397-b2cae3d40d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.691996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291e2bc-e567-40a6-b397-b2cae3d40d0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.704748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291e2bc-e567-40a6-b397-b2cae3d40d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3291e2bc-e567-40a6-b397-b2cae3d40d0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:23.714786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:23.715664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:23.716431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 14/26] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:23.717612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305fe1c-4e69-4f21-8893-c87a94ea7b77 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.717612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305fe1c-4e69-4f21-8893-c87a94ea7b77 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.717831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305fe1c-4e69-4f21-8893-c87a94ea7b77 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.719072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 15/27] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:23.727704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb54b8e-45d0-45a2-b344-edb6a8ee897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:23.728853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb54b8e-45d0-45a2-b344-edb6a8ee897f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.728853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb54b8e-45d0-45a2-b344-edb6a8ee897f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.729131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb54b8e-45d0-45a2-b344-edb6a8ee897f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.732859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305fe1c-4e69-4f21-8893-c87a94ea7b77 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:23.752584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb54b8e-45d0-45a2-b344-edb6a8ee897f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:23.756365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb54b8e-45d0-45a2-b344-edb6a8ee897f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ceb54b8e-45d0-45a2-b344-edb6a8ee897f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:04:23.793622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:23.794514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:23.795326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:04:23.795326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:04:23.795326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:23.795326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:23.795326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 13/28] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:23.796042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ecb-ecb8-4b8c-88e3-647c3ba877ed None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.796247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ecb-ecb8-4b8c-88e3-647c3ba877ed None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.796523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ecb-ecb8-4b8c-88e3-647c3ba877ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.819637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2b8c7ecb-ecb8-4b8c-88e3-647c3ba877ed None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:23.821424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2b8c7ecb-ecb8-4b8c-88e3-647c3ba877ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:23.889218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305fe1c-4e69-4f21-8893-c87a94ea7b77 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:23.897058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 14/29] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:23.898690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006140cb-f093-4f5f-bcac-cd8c64a5c617 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.899251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006140cb-f093-4f5f-bcac-cd8c64a5c617 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.899741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006140cb-f093-4f5f-bcac-cd8c64a5c617 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.901329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:23.907540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006140cb-f093-4f5f-bcac-cd8c64a5c617 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:23.944619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5518fd-dd96-4cf5-a784-41998e5bbded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:23.945645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5518fd-dd96-4cf5-a784-41998e5bbded None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.945926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5518fd-dd96-4cf5-a784-41998e5bbded None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.946213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5518fd-dd96-4cf5-a784-41998e5bbded None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.946980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5518fd-dd96-4cf5-a784-41998e5bbded None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:23.947288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5518fd-dd96-4cf5-a784-41998e5bbded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:23.948690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5518fd-dd96-4cf5-a784-41998e5bbded None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:23.950619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:23.958907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:23.961807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 16/31] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:23.963298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832d9f0-812a-4d97-bc18-b00a1659cc3c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.963594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832d9f0-812a-4d97-bc18-b00a1659cc3c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.963885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832d9f0-812a-4d97-bc18-b00a1659cc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.985180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7832d9f0-812a-4d97-bc18-b00a1659cc3c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:23.986533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7832d9f0-812a-4d97-bc18-b00a1659cc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:24.043772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006140cb-f093-4f5f-bcac-cd8c64a5c617 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.078515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 17/32] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:24.085896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832d9f0-812a-4d97-bc18-b00a1659cc3c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.091011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.091698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.091989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.092275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.093050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:24.093369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.094780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.116771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 16/33] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:24.117984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.216998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832d9f0-812a-4d97-bc18-b00a1659cc3c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.233932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.248738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb3d0a-7156-4019-8cf3-ad67d9686980 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.254513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.267380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.268135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.268355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.268642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.269438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.271481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.291725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.293365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.293955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.294432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] PATH_INFO: `/v3/users/76d529df90494c78a07e9c839c744d19` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.296292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] RBAC: Authorizing `identity:get_user(user_id=76d529df90494c78a07e9c839c744d19)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.298002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.300007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 17/34] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:24 2022] GET /identity/v3/users/76d529df90494c78a07e9c839c744d19 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:24.301011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.404645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 18/35] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jul 21 04:04:24 2022] POST /identity/v3/roles => generated 225 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:24.405647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.420500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10537-643c-4e4b-94e5-e5eee7e6af46 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.460136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e97120-c1ba-4959-88ba-c7d5749dbdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.461292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97120-c1ba-4959-88ba-c7d5749dbdf0 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.461789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97120-c1ba-4959-88ba-c7d5749dbdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.462271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97120-c1ba-4959-88ba-c7d5749dbdf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.463408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e97120-c1ba-4959-88ba-c7d5749dbdf0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.465258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e97120-c1ba-4959-88ba-c7d5749dbdf0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.521485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54921d-1b13-42b7-8567-269b17d5d576 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.560173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.560785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.561098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.561391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.562126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.564767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.596380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 19/36] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:04:24 2022] POST /identity/v3/projects => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:24.597326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.610717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jul 21 04:04:24 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:24.612687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700360a0-527f-4c4c-82e8-435cd27f1e86 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.617491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700360a0-527f-4c4c-82e8-435cd27f1e86 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.618186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700360a0-527f-4c4c-82e8-435cd27f1e86 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.620426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 19/38] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:24.626186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8db57-78bb-4c4d-a008-f4de8810277c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.626978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8db57-78bb-4c4d-a008-f4de8810277c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.627470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8db57-78bb-4c4d-a008-f4de8810277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.657167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.672019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a1f8db57-78bb-4c4d-a008-f4de8810277c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:24.674070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a1f8db57-78bb-4c4d-a008-f4de8810277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:24.696251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.792993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:24.800199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea5b09-c4b7-41d9-920d-4eb9bceb27f4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.800543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea5b09-c4b7-41d9-920d-4eb9bceb27f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.800778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea5b09-c4b7-41d9-920d-4eb9bceb27f4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.802258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 21/40] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:24.810866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724a37-7060-40dc-85be-c485fe69ecf5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.811135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724a37-7060-40dc-85be-c485fe69ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.811369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724a37-7060-40dc-85be-c485fe69ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.830174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-12724a37-7060-40dc-85be-c485fe69ecf5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:24.831435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-12724a37-7060-40dc-85be-c485fe69ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:24.870300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2125efc-922e-43c5-83b1-446a07318cba None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.918953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.919770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.920064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.920410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.921607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.922433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 22/41] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:24.923099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.924022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12724a37-7060-40dc-85be-c485fe69ecf5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.925896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 20/42] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:24.938110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.006789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.029944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12724a37-7060-40dc-85be-c485fe69ecf5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.043607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528f9ba-699a-431d-a00c-7ce92a41b51c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.050643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.064926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.065538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.065825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.066108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.066856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.068373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.078042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.078956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.079250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.079546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] PATH_INFO: `/v3/domains/default/users/76d529df90494c78a07e9c839c744d19/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.081039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 23/43] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jul 21 04:04:24 2022] POST /identity/v3/roles => generated 223 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:25.081618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=76d529df90494c78a07e9c839c744d19, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.081825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.083173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.105822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 21/44] 10.222.0.45 () {58 vars in 1361 bytes} [Thu Jul 21 04:04:24 2022] PUT /identity/v3/domains/default/users/76d529df90494c78a07e9c839c744d19/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:25.212595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210f262-9c85-4d00-950c-489ca56ae879 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.253715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2256b26-b1a3-4136-aced-f52da8234544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.254546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2256b26-b1a3-4136-aced-f52da8234544 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.254838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2256b26-b1a3-4136-aced-f52da8234544 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.255122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2256b26-b1a3-4136-aced-f52da8234544 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.256962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2256b26-b1a3-4136-aced-f52da8234544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.258483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2256b26-b1a3-4136-aced-f52da8234544 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.260175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 24/45] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:25.267031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.379707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403cf8b-daad-4186-badf-d423f19b7452 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.413771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138dce-3185-4de5-8dec-8b57a15b31d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.414433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138dce-3185-4de5-8dec-8b57a15b31d4 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.414727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138dce-3185-4de5-8dec-8b57a15b31d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.415014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138dce-3185-4de5-8dec-8b57a15b31d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.415727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35138dce-3185-4de5-8dec-8b57a15b31d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.417230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35138dce-3185-4de5-8dec-8b57a15b31d4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.441493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 22/46] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:04:25 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:27.137462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ad1dd-02b3-464b-8aaf-58933e179f4a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.137978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ad1dd-02b3-464b-8aaf-58933e179f4a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.138061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ad1dd-02b3-464b-8aaf-58933e179f4a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.139442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 25/47] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:27.144888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c02e-ceba-4086-939e-8fbb067dfaa5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.145283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c02e-ceba-4086-939e-8fbb067dfaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.145472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c02e-ceba-4086-939e-8fbb067dfaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.163568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-50f8c02e-ceba-4086-939e-8fbb067dfaa5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:27.165132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-50f8c02e-ceba-4086-939e-8fbb067dfaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:27.178754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.236036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:27.259245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ad1dd-02b3-464b-8aaf-58933e179f4a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.263213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.367237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ad1dd-02b3-464b-8aaf-58933e179f4a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.400318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306e1a5-145f-4ba2-bcce-ccd852b48782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.401080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e1a5-145f-4ba2-bcce-ccd852b48782 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.401371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e1a5-145f-4ba2-bcce-ccd852b48782 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.401656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e1a5-145f-4ba2-bcce-ccd852b48782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.413110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306e1a5-145f-4ba2-bcce-ccd852b48782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b306e1a5-145f-4ba2-bcce-ccd852b48782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:27.421921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:27.422941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:27.423745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 26/49] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:27.429061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c02e-ceba-4086-939e-8fbb067dfaa5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.480453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6743b-8586-4d3e-becf-8e7a96016d26 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.480742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6743b-8586-4d3e-becf-8e7a96016d26 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.481067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6743b-8586-4d3e-becf-8e7a96016d26 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.482444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 27/50] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:27.487405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d47096-3d80-45c0-9416-f6166a792ad8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.487697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d47096-3d80-45c0-9416-f6166a792ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.487982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d47096-3d80-45c0-9416-f6166a792ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.505399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-96d47096-3d80-45c0-9416-f6166a792ad8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:27.507337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96d47096-3d80-45c0-9416-f6166a792ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:27.528314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c02e-ceba-4086-939e-8fbb067dfaa5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.561251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.561927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.562215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.562499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.563243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:27.563555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.564382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.564984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.573383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 28/51] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:27.579077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 24/52] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:27.580145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d47096-3d80-45c0-9416-f6166a792ad8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.596797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.609607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.679479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d47096-3d80-45c0-9416-f6166a792ad8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.701147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4deda-9387-49b2-a33a-5bdd63a15df8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.713308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.714194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.714490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.714771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] PATH_INFO: `/v3/users/76d529df90494c78a07e9c839c744d19` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.715975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] RBAC: Authorizing `identity:get_user(user_id=76d529df90494c78a07e9c839c744d19)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.717486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.719109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 29/53] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/users/76d529df90494c78a07e9c839c744d19 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:27.724375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.736958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.737767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.738061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.738348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.739556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.741933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.743566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 25/54] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:27.749093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.785289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.823682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725633f-7641-449b-a7b7-24673be0b2f9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.826740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.851197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e304a-f51c-4e95-b99a-121e41317531 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.889522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.890205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.890499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.890786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.891522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.893054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.921552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 26/55] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Jul 21 04:04:27 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:04:27.968035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8cc14-88ab-4b84-ae8d-297feea3226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.968896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8cc14-88ab-4b84-ae8d-297feea3226b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.969191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8cc14-88ab-4b84-ae8d-297feea3226b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.969475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8cc14-88ab-4b84-ae8d-297feea3226b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.970769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8cc14-88ab-4b84-ae8d-297feea3226b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.972278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8cc14-88ab-4b84-ae8d-297feea3226b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.974041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 30/56] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:27.980145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:28.086616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7fd11-9f31-4c30-864c-6ae3975d6300 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:28.116268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:28.123461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb94d9-bb6f-4906-8c54-af628f5d72f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:28.124276 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb94d9-bb6f-4906-8c54-af628f5d72f8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.124803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb94d9-bb6f-4906-8c54-af628f5d72f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.125126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb94d9-bb6f-4906-8c54-af628f5d72f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.125973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb94d9-bb6f-4906-8c54-af628f5d72f8 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.domain.id=default, user.id=76d529df90494c78a07e9c839c744d19) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:28.126295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb94d9-bb6f-4906-8c54-af628f5d72f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:28.127779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb94d9-bb6f-4906-8c54-af628f5d72f8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:28.133706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 27/57] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/role_assignments?user.id=76d529df90494c78a07e9c839c744d19&scope.domain.id=default&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:29.985779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a7650-b578-403b-b6a1-40daf25fb17e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.986299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a7650-b578-403b-b6a1-40daf25fb17e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.986299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a7650-b578-403b-b6a1-40daf25fb17e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.987648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 31/58] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:29.993821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aabf2-c6ff-4b15-bb7a-7e9b19fdef09 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.994221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aabf2-c6ff-4b15-bb7a-7e9b19fdef09 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.994390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aabf2-c6ff-4b15-bb7a-7e9b19fdef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.011318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-176aabf2-c6ff-4b15-bb7a-7e9b19fdef09 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:30.012516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-176aabf2-c6ff-4b15-bb7a-7e9b19fdef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:30.076304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 28/59] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:30.100067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a7650-b578-403b-b6a1-40daf25fb17e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.199533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a7650-b578-403b-b6a1-40daf25fb17e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.226899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.233020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece17c1-1f22-423d-8e48-1a84f9e63034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.233810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece17c1-1f22-423d-8e48-1a84f9e63034 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.234101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece17c1-1f22-423d-8e48-1a84f9e63034 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.234383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece17c1-1f22-423d-8e48-1a84f9e63034 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.235562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece17c1-1f22-423d-8e48-1a84f9e63034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.237106 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece17c1-1f22-423d-8e48-1a84f9e63034 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.238662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 32/60] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.244947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aabf2-c6ff-4b15-bb7a-7e9b19fdef09 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.342000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aabf2-c6ff-4b15-bb7a-7e9b19fdef09 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.366358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.377333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7f355-714e-4b48-8ea8-444a358e98ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.378004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f355-714e-4b48-8ea8-444a358e98ad None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.378295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f355-714e-4b48-8ea8-444a358e98ad None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.378579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f355-714e-4b48-8ea8-444a358e98ad None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.379299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7f355-714e-4b48-8ea8-444a358e98ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.380764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7f355-714e-4b48-8ea8-444a358e98ad None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.404745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 29/61] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:30 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:33.594594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce18d9-00d1-4c65-96bd-108380171619 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.595636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce18d9-00d1-4c65-96bd-108380171619 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.596134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce18d9-00d1-4c65-96bd-108380171619 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.597774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 33/62] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:33.603538 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac35de-fef9-4181-ba74-c403e2dd5cf6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.604400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac35de-fef9-4181-ba74-c403e2dd5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.604935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac35de-fef9-4181-ba74-c403e2dd5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.623266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4326049-a33d-4446-b579-2cfe40684761 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.623968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4326049-a33d-4446-b579-2cfe40684761 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.624455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4326049-a33d-4446-b579-2cfe40684761 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.626084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 34/63] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:33.627558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b2ac35de-fef9-4181-ba74-c403e2dd5cf6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:33.629031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b2ac35de-fef9-4181-ba74-c403e2dd5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:33.631949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b1087-eab3-4a33-a138-2f2eee69caa4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.632461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b1087-eab3-4a33-a138-2f2eee69caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.633015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b1087-eab3-4a33-a138-2f2eee69caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.658725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-036b1087-eab3-4a33-a138-2f2eee69caa4 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:33.660437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-036b1087-eab3-4a33-a138-2f2eee69caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:33.753487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 30/64] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:33.787841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac35de-fef9-4181-ba74-c403e2dd5cf6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.819555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 35/65] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:33.852279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b1087-eab3-4a33-a138-2f2eee69caa4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.941224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac35de-fef9-4181-ba74-c403e2dd5cf6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.955897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.974087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b1087-eab3-4a33-a138-2f2eee69caa4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.989921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524daeb-a4b3-4549-9834-632ba9cdf937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.991278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524daeb-a4b3-4549-9834-632ba9cdf937 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.991570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524daeb-a4b3-4549-9834-632ba9cdf937 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.992277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524daeb-a4b3-4549-9834-632ba9cdf937 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.004745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.009088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524daeb-a4b3-4549-9834-632ba9cdf937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:34.014798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c636254-e0ea-4258-a665-ceb81c71ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.015879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c636254-e0ea-4258-a665-ceb81c71ae9e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.016371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c636254-e0ea-4258-a665-ceb81c71ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.016890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c636254-e0ea-4258-a665-ceb81c71ae9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f524daeb-a4b3-4549-9834-632ba9cdf937 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:34.018684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:34.019510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:34.020286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 31/66] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:34.021372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582be2-8d6d-44c7-8f6e-c17cb66f53fc None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.021948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582be2-8d6d-44c7-8f6e-c17cb66f53fc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.022556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582be2-8d6d-44c7-8f6e-c17cb66f53fc None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.024127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 32/67] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:34.029545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582be2-8d6d-44c7-8f6e-c17cb66f53fc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.037286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c636254-e0ea-4258-a665-ceb81c71ae9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4c636254-e0ea-4258-a665-ceb81c71ae9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:34.045617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:34.046732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:34.047715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:34.049865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 36/68] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:34.051207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33407e0d-9b56-46e1-8a0f-eb33e017a8d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.051604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33407e0d-9b56-46e1-8a0f-eb33e017a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.051995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33407e0d-9b56-46e1-8a0f-eb33e017a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.070072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-33407e0d-9b56-46e1-8a0f-eb33e017a8d0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:34.071331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-33407e0d-9b56-46e1-8a0f-eb33e017a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:34.144188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 37/69] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:34.145300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d08d1-d33e-4c50-b19f-46d2a186a04a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.145599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d08d1-d33e-4c50-b19f-46d2a186a04a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.145887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d08d1-d33e-4c50-b19f-46d2a186a04a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.147397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 38/70] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:34.147928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d08d1-d33e-4c50-b19f-46d2a186a04a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.154524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582be2-8d6d-44c7-8f6e-c17cb66f53fc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.195030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4d02-9e41-4747-97b8-61d36ff3b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.196033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4d02-9e41-4747-97b8-61d36ff3b36c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.196360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4d02-9e41-4747-97b8-61d36ff3b36c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.196805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4d02-9e41-4747-97b8-61d36ff3b36c None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.197599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4d02-9e41-4747-97b8-61d36ff3b36c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:34.197918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4d02-9e41-4747-97b8-61d36ff3b36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.199368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4d02-9e41-4747-97b8-61d36ff3b36c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.208071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 33/71] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.209355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f46a19-1ea3-4f26-b63d-f50919ae9b16 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.209650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f46a19-1ea3-4f26-b63d-f50919ae9b16 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.210021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f46a19-1ea3-4f26-b63d-f50919ae9b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.226433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-37f46a19-1ea3-4f26-b63d-f50919ae9b16 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:34.227633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-37f46a19-1ea3-4f26-b63d-f50919ae9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:34.253819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.255456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d08d1-d33e-4c50-b19f-46d2a186a04a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.273978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.292662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cca057-8055-4df7-a68e-f4e353c6d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.293377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cca057-8055-4df7-a68e-f4e353c6d498 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.293671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cca057-8055-4df7-a68e-f4e353c6d498 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.293957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cca057-8055-4df7-a68e-f4e353c6d498 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.294714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cca057-8055-4df7-a68e-f4e353c6d498 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:34.295030 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cca057-8055-4df7-a68e-f4e353c6d498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.296690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cca057-8055-4df7-a68e-f4e353c6d498 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.296793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 34/72] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:34.297528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f46a19-1ea3-4f26-b63d-f50919ae9b16 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.316479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 39/73] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.317907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfefd56-0112-4797-ba50-46bbdecb0f72 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.318217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfefd56-0112-4797-ba50-46bbdecb0f72 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.318630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfefd56-0112-4797-ba50-46bbdecb0f72 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.320019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 40/74] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:34.320737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfefd56-0112-4797-ba50-46bbdecb0f72 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.402835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f46a19-1ea3-4f26-b63d-f50919ae9b16 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.420463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfefd56-0112-4797-ba50-46bbdecb0f72 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.437211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.438018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.438304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.438585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.448573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:34.453865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.454737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.455028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.455312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] PATH_INFO: `/v3/users/76d529df90494c78a07e9c839c744d19` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.456514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=76d529df90494c78a07e9c839c744d19)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:34.456655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:34.457580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:34.463775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 35/75] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:34.465085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.465163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.465256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 41/76] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/users/76d529df90494c78a07e9c839c744d19 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.465256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.483592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.512579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.560001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf922d-7bfd-4c73-8e8f-fbfcb8110c85 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.562277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebe33e-73ea-494d-9faa-0ed922943eb0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.593736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4514ff-cc30-42bd-aa2b-bae301d32654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.594533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4514ff-cc30-42bd-aa2b-bae301d32654 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.594825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4514ff-cc30-42bd-aa2b-bae301d32654 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.595111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4514ff-cc30-42bd-aa2b-bae301d32654 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.595605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.596457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.596750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.597096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.606041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4514ff-cc30-42bd-aa2b-bae301d32654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:34.612748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2a4514ff-cc30-42bd-aa2b-bae301d32654 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:34.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:34.614692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:34.615529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:34.616145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.616212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 36/77] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:34.616274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 42/78] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.616981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aae2b-a6bb-4f8c-acef-7a3a04379c4e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.617220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.617308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aae2b-a6bb-4f8c-acef-7a3a04379c4e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.617566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aae2b-a6bb-4f8c-acef-7a3a04379c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.634064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5d6aae2b-a6bb-4f8c-acef-7a3a04379c4e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:34.635372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5d6aae2b-a6bb-4f8c-acef-7a3a04379c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:34.701921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 37/79] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:34.712987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aae2b-a6bb-4f8c-acef-7a3a04379c4e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.717776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.734255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2edabb-0cb3-46d7-8213-ac5dcce36fa3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.742651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.769748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.770427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.770728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.771017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.772308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:34.772640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.774073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.782061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 43/80] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.782862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.806225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aae2b-a6bb-4f8c-acef-7a3a04379c4e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.839585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.840237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.840525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.840802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.885451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f63dd-de76-4dbb-bac8-cef128b75801 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.909662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.911149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.918876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.919624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.919870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.920155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.920950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:34.921268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.922655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.924621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.930877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 44/81] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.931843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.964308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.010577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 38/82] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:35.011418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.035912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d41bb-7705-4744-93b6-7e68d5334767 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.069176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.070047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.070338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.070619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.108768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b1f0-3fec-494b-83e1-246ca1c63285 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.122066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.137888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.139369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.143529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.144328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.144624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.144959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.146143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.147701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.149382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 39/83] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:35.150151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.168500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.237341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 45/84] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:35.239248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.254816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368a813-9e18-459b-9513-565771cc9f49 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.288808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.289706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.289993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.290277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.291477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.292953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.294576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 40/85] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:35.295334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.337683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a002b-c9e5-40ab-b3c8-dea9978480be None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.344576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.366185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.372316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.373392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.373874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.374379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.376449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.379293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.383081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 46/86] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:35.384235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.400248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41166a0-ec58-4e62-99bf-67f5a55326f3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.433822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.434687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.434975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.435255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.436436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.437920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.439604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 41/87] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:35.440366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.495417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95530c-9068-4fcb-96d0-2228250c9a82 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.528813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.529509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.529795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.530074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.530784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.532225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.540370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63b649-4310-4003-a420-c863d966a1a6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.558146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 47/88] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:35 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:35.558304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.558877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.593852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.594991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.595669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.597021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.598502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.600618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.602722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 42/89] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:35.603644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.623152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.681283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019197f-0d60-4e95-a524-9f467b846c32 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.721401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.722070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.722366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.722653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.732797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089860f-01f3-4c16-861a-a7822493d038 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.776651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.777439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.777734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.778025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.808970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.810887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.844995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.864305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.867096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.890169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.947659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 48/90] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:35.948608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:35.994363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 43/91] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:35.995236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.066356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6504-39ee-4027-968d-7349988fc9e7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.083540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:36.102747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac929011-1e11-4de2-8073-e07265fc31cb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.105557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.106237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.106528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.106816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.107787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=76d529df90494c78a07e9c839c744d19) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:36.108111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.109610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.119126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 49/92] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/role_assignments?user.id=76d529df90494c78a07e9c839c744d19&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:36.119986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.154477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:36.167749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.168442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.168740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.169055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.169921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=d303ee7e56ab47ceaf4c6157d31aa0f1) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:36.170244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.171775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.183398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 44/93] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:35 2022] GET /identity/v3/role_assignments?user.id=d303ee7e56ab47ceaf4c6157d31aa0f1&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=d428254d31484e108ec67491b911bc1f => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:36.184291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.353407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483f35a-de25-4f34-9f2a-ad652cd743ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.391919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa161-be25-4247-8608-fc429598c567 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.419784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.421037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.421557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.422039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.424840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.426595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.430229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 50/94] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:36.436419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.461418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.463272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.464088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.466473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] PATH_INFO: `/v3/projects/36355df14fad4dcd961c46ca0b125496` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.467993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] RBAC: Authorizing `identity:get_project(project_id=36355df14fad4dcd961c46ca0b125496)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.470512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.473581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 45/95] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/projects/36355df14fad4dcd961c46ca0b125496 => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:36.480496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.518754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:36.616001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:36.645964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077edb9-8bf5-41a0-9ba4-2dc7cde2ef88 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.702581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866ade7-8dd3-4eb5-b8a5-af238df1c672 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.703664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df21255-bd94-4c09-b822-b72c2f01ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.704727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21255-bd94-4c09-b822-b72c2f01ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.705330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21255-bd94-4c09-b822-b72c2f01ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.705808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df21255-bd94-4c09-b822-b72c2f01ecc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.706869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21255-bd94-4c09-b822-b72c2f01ecc3 None admin] RBAC: Adding query filter params (role.id=1be9be19909c40699636c4973a021627, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=d303ee7e56ab47ceaf4c6157d31aa0f1) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:36.707408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21255-bd94-4c09-b822-b72c2f01ecc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.709153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df21255-bd94-4c09-b822-b72c2f01ecc3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.716557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 51/96] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/role_assignments?user.id=d303ee7e56ab47ceaf4c6157d31aa0f1&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=1be9be19909c40699636c4973a021627 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:36.781713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6b478-43cf-4cc0-a14b-a95d48a2020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.782396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6b478-43cf-4cc0-a14b-a95d48a2020a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.782660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6b478-43cf-4cc0-a14b-a95d48a2020a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.782955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6b478-43cf-4cc0-a14b-a95d48a2020a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.783789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6b478-43cf-4cc0-a14b-a95d48a2020a None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=36355df14fad4dcd961c46ca0b125496, user.id=d303ee7e56ab47ceaf4c6157d31aa0f1) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:36.784185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6b478-43cf-4cc0-a14b-a95d48a2020a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.785674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6b478-43cf-4cc0-a14b-a95d48a2020a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.797566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 46/97] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/role_assignments?user.id=d303ee7e56ab47ceaf4c6157d31aa0f1&scope.project.id=36355df14fad4dcd961c46ca0b125496&role.id=d428254d31484e108ec67491b911bc1f => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:38.259205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5698d-5bb2-45f1-880d-ef005084a691 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.260245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5698d-5bb2-45f1-880d-ef005084a691 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.260775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5698d-5bb2-45f1-880d-ef005084a691 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.262410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 52/98] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:38.270448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55042ce4-b7de-4af8-b4f4-95785822370f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.271304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55042ce4-b7de-4af8-b4f4-95785822370f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.272057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55042ce4-b7de-4af8-b4f4-95785822370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.289658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-55042ce4-b7de-4af8-b4f4-95785822370f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:38.291203 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-55042ce4-b7de-4af8-b4f4-95785822370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:38.381884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 47/99] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:38.409966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185ad3-6809-4f5d-b566-e10252a1fc72 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.410592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185ad3-6809-4f5d-b566-e10252a1fc72 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.411100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185ad3-6809-4f5d-b566-e10252a1fc72 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.413025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 53/100] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:38.414951 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55042ce4-b7de-4af8-b4f4-95785822370f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.427054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.433561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f858c1e-200b-4e38-b97b-e6eafe79cd9e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.433859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f858c1e-200b-4e38-b97b-e6eafe79cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.434152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f858c1e-200b-4e38-b97b-e6eafe79cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.461244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2f858c1e-200b-4e38-b97b-e6eafe79cd9e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:38.462460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2f858c1e-200b-4e38-b97b-e6eafe79cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:38.547727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55042ce4-b7de-4af8-b4f4-95785822370f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.583467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.584316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.584607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.584922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.586111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:38.587691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:38.589526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 48/101] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:38.595508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.735096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 54/102] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:38.736608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.778492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f858c1e-200b-4e38-b97b-e6eafe79cd9e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.780137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cb5f7-9c1f-4985-a9c9-23a1a55bdf04 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.854200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a535d1-3806-4d0a-a517-aeba83febf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.855208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a535d1-3806-4d0a-a517-aeba83febf1a None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.855702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a535d1-3806-4d0a-a517-aeba83febf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.856187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a535d1-3806-4d0a-a517-aeba83febf1a None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.857154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a535d1-3806-4d0a-a517-aeba83febf1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:38.858884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a535d1-3806-4d0a-a517-aeba83febf1a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:38.901968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 49/103] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:04:38 2022] POST /identity/v3/projects => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:38.963178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153da74-b66b-4222-b727-b48fb66cff05 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.964548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153da74-b66b-4222-b727-b48fb66cff05 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.965176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153da74-b66b-4222-b727-b48fb66cff05 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.967683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 50/104] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:38.971873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.978071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709649f6-6799-4adb-a397-2f0b6a269778 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.979896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709649f6-6799-4adb-a397-2f0b6a269778 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.980415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709649f6-6799-4adb-a397-2f0b6a269778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.004207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-709649f6-6799-4adb-a397-2f0b6a269778 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:39.006435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-709649f6-6799-4adb-a397-2f0b6a269778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:39.008987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f858c1e-200b-4e38-b97b-e6eafe79cd9e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.093357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 51/105] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:39.097059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.097878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.098164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.098447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.121239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709649f6-6799-4adb-a397-2f0b6a269778 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.129973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:39.138266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:39.139189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:39.139980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 55/106] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:39.145339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.267272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39d32e-7aed-4949-8aed-6a2c43ec1681 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.285189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.308851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.309553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.311228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.311518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.312280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:39.312592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.314026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.335239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 56/107] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:39.340742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.345780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.378847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709649f6-6799-4adb-a397-2f0b6a269778 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.453166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.453980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.454273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.454559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.472510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:39.488556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:39.489526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:39.491027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:39.495651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 52/108] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:39.501518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.549002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875df01-e2dd-4ff0-ab49-658ebbe5b17c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.604741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde536f7-5d79-41b1-a955-903bbd9fd1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.605773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde536f7-5d79-41b1-a955-903bbd9fd1fe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.606065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde536f7-5d79-41b1-a955-903bbd9fd1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.606346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde536f7-5d79-41b1-a955-903bbd9fd1fe None admin] PATH_INFO: `/v3/users/c2548b49e0ce43318e9ffa0ae8efa3cc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.621029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde536f7-5d79-41b1-a955-903bbd9fd1fe None admin] RBAC: Authorizing `identity:get_user(user_id=c2548b49e0ce43318e9ffa0ae8efa3cc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.622861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde536f7-5d79-41b1-a955-903bbd9fd1fe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.624750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 57/109] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/users/c2548b49e0ce43318e9ffa0ae8efa3cc => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:39.626040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2543-1644-4190-898f-b2b0b8b780ee None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.626329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2543-1644-4190-898f-b2b0b8b780ee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.626611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2543-1644-4190-898f-b2b0b8b780ee None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.632554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 58/110] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:39.634232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba220a0-4403-4539-a764-85bf016439b9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.634593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba220a0-4403-4539-a764-85bf016439b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.634880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba220a0-4403-4539-a764-85bf016439b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.651072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a158ac0-43a1-499d-8f75-fac4a5f027c7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.657955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aba220a0-4403-4539-a764-85bf016439b9 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:39.659287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aba220a0-4403-4539-a764-85bf016439b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:39.672406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.696727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.697448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.697738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.698026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.698801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:39.699119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.701501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.712213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 53/111] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:39.717673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.752233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.767176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 59/112] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:39.772863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950e4f2-2daf-4f9f-aa5a-b03ac1fd130b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.772863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950e4f2-2daf-4f9f-aa5a-b03ac1fd130b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.772863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950e4f2-2daf-4f9f-aa5a-b03ac1fd130b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.772863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 60/113] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:39.772863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950e4f2-2daf-4f9f-aa5a-b03ac1fd130b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.853900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a7da-6b2f-4b4b-9e34-4c147eecd516 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.888579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.889293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.889587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.889878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.900733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950e4f2-2daf-4f9f-aa5a-b03ac1fd130b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.942544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.952624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb9266-efb4-417e-ab97-d30dd1528139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.954601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb9266-efb4-417e-ab97-d30dd1528139 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.954888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb9266-efb4-417e-ab97-d30dd1528139 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.955168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb9266-efb4-417e-ab97-d30dd1528139 None admin] PATH_INFO: `/v3/users/76d529df90494c78a07e9c839c744d19` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.957044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb9266-efb4-417e-ab97-d30dd1528139 None admin] RBAC: Authorizing `identity:get_user(user_id=76d529df90494c78a07e9c839c744d19)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.958526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb9266-efb4-417e-ab97-d30dd1528139 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.961541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 61/114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/users/76d529df90494c78a07e9c839c744d19 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:39.963027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d810-03b7-4251-a29c-394d054542ae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.963027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d810-03b7-4251-a29c-394d054542ae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.963027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d810-03b7-4251-a29c-394d054542ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.972188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.975705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.984451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7b99d810-03b7-4251-a29c-394d054542ae None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:39.986019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7b99d810-03b7-4251-a29c-394d054542ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:40.062163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.082032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 62/115] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:40.085797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d810-03b7-4251-a29c-394d054542ae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.096124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 54/116] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:40.097150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.193736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.194446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d810-03b7-4251-a29c-394d054542ae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.217214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44657-7cc4-434f-bf94-bfe49bcf5308 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.229727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ec036-53ec-4efc-98d0-504d45c30254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.230539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ec036-53ec-4efc-98d0-504d45c30254 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.230831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ec036-53ec-4efc-98d0-504d45c30254 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.231116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ec036-53ec-4efc-98d0-504d45c30254 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.242520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ec036-53ec-4efc-98d0-504d45c30254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f70ec036-53ec-4efc-98d0-504d45c30254 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:40.250339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:40.251181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:40.251929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 63/117] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:40.253098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40282f77-fa93-4e59-8df2-fd9c57f41f52 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.253378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40282f77-fa93-4e59-8df2-fd9c57f41f52 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.253562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40282f77-fa93-4e59-8df2-fd9c57f41f52 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.254993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 64/118] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:40.255570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40282f77-fa93-4e59-8df2-fd9c57f41f52 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.266822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.267705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.267997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.268280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.269927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.272300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.274345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 55/119] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.277805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.313868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.370592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40282f77-fa93-4e59-8df2-fd9c57f41f52 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.390761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b8893-c3da-4aa9-bf6c-768667dee972 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.408212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.409116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.409408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.409691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.410872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.412915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.414626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 65/120] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.415396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.435899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1366cc-ef0c-4c8e-94ab-b23d67047145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.436708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1366cc-ef0c-4c8e-94ab-b23d67047145 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.437029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1366cc-ef0c-4c8e-94ab-b23d67047145 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.437344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1366cc-ef0c-4c8e-94ab-b23d67047145 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.447862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1366cc-ef0c-4c8e-94ab-b23d67047145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9d1366cc-ef0c-4c8e-94ab-b23d67047145 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:40.455612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:40.456480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:40.457837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 56/121] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:40.458476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc74f-d19d-4865-bdcc-8cc723a65c96 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.458476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc74f-d19d-4865-bdcc-8cc723a65c96 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.458598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc74f-d19d-4865-bdcc-8cc723a65c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.477480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-031dc74f-d19d-4865-bdcc-8cc723a65c96 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:40.478924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-031dc74f-d19d-4865-bdcc-8cc723a65c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:40.483064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.530406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11316f1-6552-4ef1-91a7-56770610aa2f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.547536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.554221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 57/122] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:40.555341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc74f-d19d-4865-bdcc-8cc723a65c96 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.577865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.578656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.579021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.579463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.580524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:40.581031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.582592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.592372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 66/123] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.596855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.685609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc74f-d19d-4865-bdcc-8cc723a65c96 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.712900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a40a0-ceca-4a52-b49c-fd6ac4f4abf0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.721324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.722226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.722523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.722813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/76d529df90494c78a07e9c839c744d19/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.725379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2ef030d9f2488986abf43273a1dee2, user_id=76d529df90494c78a07e9c839c744d19, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.726960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.736866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.742917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 58/124] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:40 2022] PUT /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/76d529df90494c78a07e9c839c744d19/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:40.744128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.763086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.763802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.764168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.764614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.765588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] RBAC: Adding query filter params (role.id=3e5863fab95146c0a8f915731b4174e3, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=c2548b49e0ce43318e9ffa0ae8efa3cc) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:40.766044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.767824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.776190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 67/125] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/role_assignments?user.id=c2548b49e0ce43318e9ffa0ae8efa3cc&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=3e5863fab95146c0a8f915731b4174e3 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.777061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.834987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.873981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff614ecd-e42a-4c91-93ac-923ca3519482 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.907823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd85f5e-c351-4f76-a513-e043a3af5b27 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.919389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.920412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.920946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.921414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.922361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:40.922861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.924479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.934507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 59/126] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.935391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.958445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.958918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.960001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.973837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:40.984227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:40.985371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:40.986336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:40.988546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 68/127] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:40.989570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.008159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.072159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1216b1e-626e-4efa-bf0a-a33b51047dd6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.121545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.123146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.123532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.123914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.124887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca146cc7-b757-40ae-b2cd-353c26af87e7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.125445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.128088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.130197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 60/128] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.131556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.162649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.182069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.183599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.185759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.186262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.189926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.192559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.201464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 69/129] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.203410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.339767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7222d1c-6c9d-408c-95ac-97fc596948cc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.383164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.390356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.391173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.391710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.391936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.392806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:41.393254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.394788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.394956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17eb4e-8962-4911-a6da-ba8c98d3f135 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.408854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 61/130] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.408854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.450488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.451628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.452084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.452567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] PATH_INFO: `/v3/projects/36355df14fad4dcd961c46ca0b125496` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.454198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] RBAC: Authorizing `identity:get_project(project_id=36355df14fad4dcd961c46ca0b125496)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.455911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.458026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 70/131] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/projects/36355df14fad4dcd961c46ca0b125496 => generated 312 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.458928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.520847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f449c1-33be-4caa-abd4-94530c2592d9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.556801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.557923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.558317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.558757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.560109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.561965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.563786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 62/132] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.564561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.580195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.651833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.701274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddf15a-6da6-4e17-a7da-23336e5c4272 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.719743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74c475-dbfe-421b-9d94-8e1114b6cc8a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.739126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.740202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.740615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.741009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] PATH_INFO: `/v3/projects/36355df14fad4dcd961c46ca0b125496/users/d303ee7e56ab47ceaf4c6157d31aa0f1/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.743470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=36355df14fad4dcd961c46ca0b125496, user_id=d303ee7e56ab47ceaf4c6157d31aa0f1, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.745138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.763133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 63/133] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:41 2022] PUT /identity/v3/projects/36355df14fad4dcd961c46ca0b125496/users/d303ee7e56ab47ceaf4c6157d31aa0f1/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:41.764108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.798615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.799515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.799804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.800089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.803010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.805205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.806990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 71/134] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.813831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.926918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562555c-60b2-4989-8cbd-c767f9260059 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.946063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaac85-8e34-48be-a187-34028e1bc1c2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.948121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.961475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c9b9-213d-4a95-acf9-59bf8d84ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.962372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c9b9-213d-4a95-acf9-59bf8d84ee2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.962665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c9b9-213d-4a95-acf9-59bf8d84ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.962954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c9b9-213d-4a95-acf9-59bf8d84ee2f None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.964222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c9b9-213d-4a95-acf9-59bf8d84ee2f None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.965793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c9b9-213d-4a95-acf9-59bf8d84ee2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.967783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 72/135] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.971112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.972944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406c65-49c2-4fa7-884e-37912832f9b6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.973370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406c65-49c2-4fa7-884e-37912832f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.973671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406c65-49c2-4fa7-884e-37912832f9b6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.975632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 73/136] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:41.981624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53406c65-49c2-4fa7-884e-37912832f9b6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.998466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa2ed2-a00a-4c57-927b-9d8506c76b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.999403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa2ed2-a00a-4c57-927b-9d8506c76b89 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.999698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa2ed2-a00a-4c57-927b-9d8506c76b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.999987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa2ed2-a00a-4c57-927b-9d8506c76b89 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/d303ee7e56ab47ceaf4c6157d31aa0f1/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.002168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa2ed2-a00a-4c57-927b-9d8506c76b89 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2ef030d9f2488986abf43273a1dee2, user_id=d303ee7e56ab47ceaf4c6157d31aa0f1, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:42.003664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa2ed2-a00a-4c57-927b-9d8506c76b89 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:42.028638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 64/137] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:41 2022] PUT /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/d303ee7e56ab47ceaf4c6157d31aa0f1/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:42.030580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccd888-d003-44f5-9fa4-5eadc0e64c24 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.031082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccd888-d003-44f5-9fa4-5eadc0e64c24 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.031568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccd888-d003-44f5-9fa4-5eadc0e64c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.053906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d5ccd888-d003-44f5-9fa4-5eadc0e64c24 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:42.055569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d5ccd888-d003-44f5-9fa4-5eadc0e64c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:42.102701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53406c65-49c2-4fa7-884e-37912832f9b6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:42.139555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:42.140464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.140756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.141083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/d303ee7e56ab47ceaf4c6157d31aa0f1/roles/1be9be19909c40699636c4973a021627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.143474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2ef030d9f2488986abf43273a1dee2, user_id=d303ee7e56ab47ceaf4c6157d31aa0f1, role_id=1be9be19909c40699636c4973a021627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:42.145116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:42.166194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 74/138] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:41 2022] PUT /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/d303ee7e56ab47ceaf4c6157d31aa0f1/roles/1be9be19909c40699636c4973a021627 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:42.179647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 65/139] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:42.220052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:42.278290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:42.359190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0bcfb-fab8-4272-b527-b44fdc045b00 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:42.398189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2686ccb-1c46-49a6-b43e-d404d5c8334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:42.399006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2686ccb-1c46-49a6-b43e-d404d5c8334f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.399297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2686ccb-1c46-49a6-b43e-d404d5c8334f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.399580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2686ccb-1c46-49a6-b43e-d404d5c8334f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.400809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2686ccb-1c46-49a6-b43e-d404d5c8334f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:42.402350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2686ccb-1c46-49a6-b43e-d404d5c8334f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:42.404438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 75/140] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:42.410101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccd888-d003-44f5-9fa4-5eadc0e64c24 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:42.528680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccd888-d003-44f5-9fa4-5eadc0e64c24 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:42.543219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:42.570966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fbe05-c050-46c5-a2fd-c807982eaecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:42.571702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fbe05-c050-46c5-a2fd-c807982eaecc None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.571998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fbe05-c050-46c5-a2fd-c807982eaecc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.572286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fbe05-c050-46c5-a2fd-c807982eaecc None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.573038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fbe05-c050-46c5-a2fd-c807982eaecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:42.574506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fbe05-c050-46c5-a2fd-c807982eaecc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:42.605334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 66/141] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:42 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:43.424422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6841-009f-48b0-a3eb-d4cd550cffec None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.425063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6841-009f-48b0-a3eb-d4cd550cffec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.425063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6841-009f-48b0-a3eb-d4cd550cffec None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.426398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 76/142] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:43.432663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc1776-44a9-4adc-9db0-a40ba17086de None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.433110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc1776-44a9-4adc-9db0-a40ba17086de None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.433296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc1776-44a9-4adc-9db0-a40ba17086de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.453254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0cdc1776-44a9-4adc-9db0-a40ba17086de None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:43.454443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0cdc1776-44a9-4adc-9db0-a40ba17086de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:43.532663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 67/143] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:43.556624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6841-009f-48b0-a3eb-d4cd550cffec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.674749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6841-009f-48b0-a3eb-d4cd550cffec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.676894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:43.715719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893829bb-42ac-41c6-b76f-70e1cd8a8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:43.716527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893829bb-42ac-41c6-b76f-70e1cd8a8fff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.716814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893829bb-42ac-41c6-b76f-70e1cd8a8fff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.717126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893829bb-42ac-41c6-b76f-70e1cd8a8fff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.730850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893829bb-42ac-41c6-b76f-70e1cd8a8fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-893829bb-42ac-41c6-b76f-70e1cd8a8fff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:43.738668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:43.739573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:43.741071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 77/144] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:43.746608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc1776-44a9-4adc-9db0-a40ba17086de None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.778804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85340d8-7213-4208-891c-36794450cef8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.779112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85340d8-7213-4208-891c-36794450cef8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.779355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85340d8-7213-4208-891c-36794450cef8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.780921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 78/145] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:43.786347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc54f4-3436-4f52-86ab-415051ffe58b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.786630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc54f4-3436-4f52-86ab-415051ffe58b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.786915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc54f4-3436-4f52-86ab-415051ffe58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.814932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fefc54f4-3436-4f52-86ab-415051ffe58b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:43.816134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fefc54f4-3436-4f52-86ab-415051ffe58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:43.933045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:43.942334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc1776-44a9-4adc-9db0-a40ba17086de None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.947216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 79/146] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:43.980609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07780151-d188-4987-8535-004a65907084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:43.981325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07780151-d188-4987-8535-004a65907084 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.981663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07780151-d188-4987-8535-004a65907084 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.981913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07780151-d188-4987-8535-004a65907084 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.982825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07780151-d188-4987-8535-004a65907084 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:43.983137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07780151-d188-4987-8535-004a65907084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:43.984551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07780151-d188-4987-8535-004a65907084 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:43.993626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 68/147] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:43.997890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc54f4-3436-4f52-86ab-415051ffe58b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.008157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07780151-d188-4987-8535-004a65907084 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.194214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.207780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc54f4-3436-4f52-86ab-415051ffe58b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.235142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07780151-d188-4987-8535-004a65907084 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.285814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.286701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.286914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.287036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.287289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] PATH_INFO: `/v3/users/c2548b49e0ce43318e9ffa0ae8efa3cc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.287777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.288073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.288354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.288542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] RBAC: Authorizing `identity:get_user(user_id=c2548b49e0ce43318e9ffa0ae8efa3cc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.290171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.291812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 69/148] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/users/c2548b49e0ce43318e9ffa0ae8efa3cc => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:44.297206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.309915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:44.324863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:44.325809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:44.326590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 80/149] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:44.336495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.344587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.471891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48a95-b11e-4697-80ad-eb7332dc83e3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.525091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.526477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.526989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.527471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.529070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.531438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.533552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 70/150] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:44.539688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.580727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371789b1-bb27-4a59-9059-bebc300dfd62 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.655874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.656599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.656922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.657219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.657998 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:44.658315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.659733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.669324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 81/151] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:44.674706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.692169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.732685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.755013 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d65d2-9b74-4662-bd22-c941fe578a53 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.826973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc993-67f1-4562-8334-ac045ce57b8d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.838202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.839125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.839416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.839704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/c2548b49e0ce43318e9ffa0ae8efa3cc/roles/3e5863fab95146c0a8f915731b4174e3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.845676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2ef030d9f2488986abf43273a1dee2, user_id=c2548b49e0ce43318e9ffa0ae8efa3cc, role_id=3e5863fab95146c0a8f915731b4174e3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.847126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.872254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 71/152] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:44 2022] PUT /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2/users/c2548b49e0ce43318e9ffa0ae8efa3cc/roles/3e5863fab95146c0a8f915731b4174e3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:44.881928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.882852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.883139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.883424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] PATH_INFO: `/v3/users/76d529df90494c78a07e9c839c744d19` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.888401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] RBAC: Authorizing `identity:get_user(user_id=76d529df90494c78a07e9c839c744d19)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.889939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.892081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 82/153] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/users/76d529df90494c78a07e9c839c744d19 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:44.898005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.028263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ade1ab-2588-495f-857b-73e4fdef89b9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.073946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69b72d-c5da-49a8-ab3e-6fc8be339ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.074613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b72d-c5da-49a8-ab3e-6fc8be339ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.074900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b72d-c5da-49a8-ab3e-6fc8be339ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.075185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b72d-c5da-49a8-ab3e-6fc8be339ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.110231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:45.161127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69b72d-c5da-49a8-ab3e-6fc8be339ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.162708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69b72d-c5da-49a8-ab3e-6fc8be339ec3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.297166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 72/154] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:45.303603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.481741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:45.506938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc93e8-5941-4c9c-b1b4-57d4a21fd28e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.506938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc93e8-5941-4c9c-b1b4-57d4a21fd28e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.507553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc93e8-5941-4c9c-b1b4-57d4a21fd28e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.511499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 73/155] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:45.511689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688c26-8d43-47c2-beac-5dd84fd64d07 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.523620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ae8b-1320-490f-b86e-68712925aa23 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.523921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ae8b-1320-490f-b86e-68712925aa23 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.524189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ae8b-1320-490f-b86e-68712925aa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.569977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2290ae8b-1320-490f-b86e-68712925aa23 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:45.573453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2290ae8b-1320-490f-b86e-68712925aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:45.606552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.608258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.608766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.612305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.614126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.615922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.618224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 83/156] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:45 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:45.624052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.694653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:45.748086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 74/157] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:45.753057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285704-b505-4a07-a30c-f4573a214d21 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.753361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285704-b505-4a07-a30c-f4573a214d21 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.753653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285704-b505-4a07-a30c-f4573a214d21 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.754984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 75/158] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:45.761204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00326c1-1285-419c-ba08-34fd8ecdb6a8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.761494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00326c1-1285-419c-ba08-34fd8ecdb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.761783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00326c1-1285-419c-ba08-34fd8ecdb6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.793932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f00326c1-1285-419c-ba08-34fd8ecdb6a8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:45.795146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f00326c1-1285-419c-ba08-34fd8ecdb6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:45.931780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d4e8a-9228-4dec-bd05-e3ae8bcd54c9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.978194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 76/159] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:45.979214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00326c1-1285-419c-ba08-34fd8ecdb6a8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.025639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:46.026687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.027184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.027685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.028807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=76d529df90494c78a07e9c839c744d19) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:46.029374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:46.031374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:46.044380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 84/160] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:45 2022] GET /identity/v3/role_assignments?user.id=76d529df90494c78a07e9c839c744d19&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:46.045816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.076872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:46.286880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00326c1-1285-419c-ba08-34fd8ecdb6a8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:46.342410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:46.354631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e40d-6901-4594-9694-31e258853db3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:46.442160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa75fe-68af-4991-8cd9-f5afc53947c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:46.442989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa75fe-68af-4991-8cd9-f5afc53947c9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.443271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa75fe-68af-4991-8cd9-f5afc53947c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.444088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa75fe-68af-4991-8cd9-f5afc53947c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.475387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a377ef9-b8fd-4389-bd2a-da56c1386377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:46.476604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377ef9-b8fd-4389-bd2a-da56c1386377 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.477113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377ef9-b8fd-4389-bd2a-da56c1386377 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.477433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa75fe-68af-4991-8cd9-f5afc53947c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:46.477880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377ef9-b8fd-4389-bd2a-da56c1386377 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-96fa75fe-68af-4991-8cd9-f5afc53947c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:46.489474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:46.491156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:46.491945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 77/161] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 513 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:46.492962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b8483-3faf-47ff-ab9f-bf386feab167 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.493258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b8483-3faf-47ff-ab9f-bf386feab167 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.493703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b8483-3faf-47ff-ab9f-bf386feab167 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.495123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 78/162] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:46.501798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b8483-3faf-47ff-ab9f-bf386feab167 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.512045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a377ef9-b8fd-4389-bd2a-da56c1386377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2a377ef9-b8fd-4389-bd2a-da56c1386377 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:46.524418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:46.525383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:46.526237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:46.532564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 85/163] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 487 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:46.534122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44bbd-88cf-4af6-9af2-058d1cf013d2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.536089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44bbd-88cf-4af6-9af2-058d1cf013d2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.536573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44bbd-88cf-4af6-9af2-058d1cf013d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.574163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-10a44bbd-88cf-4af6-9af2-058d1cf013d2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:46.575782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10a44bbd-88cf-4af6-9af2-058d1cf013d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:46.734173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 86/164] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:46.735038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44bbd-88cf-4af6-9af2-058d1cf013d2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.745087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:46.758459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b8483-3faf-47ff-ab9f-bf386feab167 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:46.829491 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:46.830178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.830468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.830758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.831526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:46.831842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:46.833348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:46.846920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 79/165] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:46.847717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.925182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.006987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44bbd-88cf-4af6-9af2-058d1cf013d2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.083158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cbd3f-f7e8-40c0-8a2b-fe01efe4c4ac None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.094849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.095536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.095821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.096094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.096864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:47.097176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.098564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.119569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 87/166] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:47.120537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.156267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.157119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.157403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.157684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.183155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:47.190977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:47.191860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:47.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 80/167] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:47.194838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.225938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.273316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0187c1-a769-4da0-b4c5-7a9d54a2a72d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.342310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d517a-d493-4d85-88e7-bf4177bab22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.343277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d517a-d493-4d85-88e7-bf4177bab22d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.343577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d517a-d493-4d85-88e7-bf4177bab22d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.343981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d517a-d493-4d85-88e7-bf4177bab22d None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.344285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.346894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d517a-d493-4d85-88e7-bf4177bab22d None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.348393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d517a-d493-4d85-88e7-bf4177bab22d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.352645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05e2a-706e-4f64-949f-4661590a7625 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.354206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 88/168] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:47.355475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925e50-9c11-4c1c-beee-ec7795ee5b5c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.355768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925e50-9c11-4c1c-beee-ec7795ee5b5c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.356054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925e50-9c11-4c1c-beee-ec7795ee5b5c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 89/169] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:47.362192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925e50-9c11-4c1c-beee-ec7795ee5b5c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.392748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.393660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.393943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.394219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.395415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.397485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.399581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 81/170] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:47.400497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.533692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ebf3-0f41-460a-a412-6a4e656fa215 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.596351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925e50-9c11-4c1c-beee-ec7795ee5b5c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.601606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.602290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.602584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.602872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.664305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed7f95-e467-442f-a843-6ff6daf51273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.666491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7f95-e467-442f-a843-6ff6daf51273 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.666783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7f95-e467-442f-a843-6ff6daf51273 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.667066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7f95-e467-442f-a843-6ff6daf51273 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.667837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed7f95-e467-442f-a843-6ff6daf51273 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:47.670521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed7f95-e467-442f-a843-6ff6daf51273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.671951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed7f95-e467-442f-a843-6ff6daf51273 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.674294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.679957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.697700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 90/171] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:47.699766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6987bc-f4c0-490e-9e66-56a113f8a5d4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.700059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6987bc-f4c0-490e-9e66-56a113f8a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.700342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6987bc-f4c0-490e-9e66-56a113f8a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.725036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3d6987bc-f4c0-490e-9e66-56a113f8a5d4 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:47.726754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3d6987bc-f4c0-490e-9e66-56a113f8a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:47.759363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.769758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.800141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 91/172] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:47.801769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6987bc-f4c0-490e-9e66-56a113f8a5d4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.904248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 82/173] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:47.905537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.911473 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6987bc-f4c0-490e-9e66-56a113f8a5d4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.939800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.950294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.951187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.951702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.952126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.973699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.014753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ccd67-ebc6-40c2-9cce-3451f02e98d6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.028475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.030002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.052599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc05e3-0a24-4ed4-8571-a2e1dc4aba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.053528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc05e3-0a24-4ed4-8571-a2e1dc4aba49 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.053808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc05e3-0a24-4ed4-8571-a2e1dc4aba49 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.054084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc05e3-0a24-4ed4-8571-a2e1dc4aba49 None admin] PATH_INFO: `/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.055278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc05e3-0a24-4ed4-8571-a2e1dc4aba49 None admin] RBAC: Authorizing `identity:get_user(user_id=d303ee7e56ab47ceaf4c6157d31aa0f1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.056734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc05e3-0a24-4ed4-8571-a2e1dc4aba49 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.058416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 83/174] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/users/d303ee7e56ab47ceaf4c6157d31aa0f1 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:48.059581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199c7f-4d8d-4cc4-8aef-d0d3fbfc844e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.059869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199c7f-4d8d-4cc4-8aef-d0d3fbfc844e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.060148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199c7f-4d8d-4cc4-8aef-d0d3fbfc844e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.061551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 84/175] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:48.065740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199c7f-4d8d-4cc4-8aef-d0d3fbfc844e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.138449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 92/176] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:48.139110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.167380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.183512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199c7f-4d8d-4cc4-8aef-d0d3fbfc844e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.216159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.222481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e0ebc-59ff-4482-8976-0d65c35dd7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.223287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0ebc-59ff-4482-8976-0d65c35dd7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.223573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0ebc-59ff-4482-8976-0d65c35dd7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.223855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0ebc-59ff-4482-8976-0d65c35dd7b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.235637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e0ebc-59ff-4482-8976-0d65c35dd7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-484e0ebc-59ff-4482-8976-0d65c35dd7b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:48.243893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:48.244988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:48.245787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:48.246401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c84fd-5807-4c3a-847c-8b0526472f24 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.246473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 85/177] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:48.246473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6703d-8e0e-4be1-a849-6856992cd1e3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.246916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6703d-8e0e-4be1-a849-6856992cd1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.247005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6703d-8e0e-4be1-a849-6856992cd1e3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.248273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 86/178] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:48.249273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6703d-8e0e-4be1-a849-6856992cd1e3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.281796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433999de-9a70-4012-9b8d-dedceef43407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.282640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433999de-9a70-4012-9b8d-dedceef43407 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.282931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433999de-9a70-4012-9b8d-dedceef43407 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.283215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433999de-9a70-4012-9b8d-dedceef43407 None admin] PATH_INFO: `/v3/projects/36355df14fad4dcd961c46ca0b125496` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.284393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433999de-9a70-4012-9b8d-dedceef43407 None admin] RBAC: Authorizing `identity:get_project(project_id=36355df14fad4dcd961c46ca0b125496)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.285906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433999de-9a70-4012-9b8d-dedceef43407 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.288612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 93/179] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/projects/36355df14fad4dcd961c46ca0b125496 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:48.289797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e36a3-d1a3-4155-97a2-e8419cffee22 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.290092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e36a3-d1a3-4155-97a2-e8419cffee22 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.290379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e36a3-d1a3-4155-97a2-e8419cffee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.306570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-544e36a3-d1a3-4155-97a2-e8419cffee22 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:48.307769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-544e36a3-d1a3-4155-97a2-e8419cffee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:48.358771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6703d-8e0e-4be1-a849-6856992cd1e3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.373619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 94/180] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:48.381684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e36a3-d1a3-4155-97a2-e8419cffee22 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.393803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d74633-5261-444c-807d-4dd680210dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.394643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d74633-5261-444c-807d-4dd680210dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.395100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d74633-5261-444c-807d-4dd680210dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.395528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d74633-5261-444c-807d-4dd680210dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.406191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.454429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.464031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d74633-5261-444c-807d-4dd680210dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.465662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d74633-5261-444c-807d-4dd680210dd5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.481493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e36a3-d1a3-4155-97a2-e8419cffee22 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.515488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83e0f8-a82a-4084-80e1-73ffc3c5d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.516441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e0f8-a82a-4084-80e1-73ffc3c5d3cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.516731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e0f8-a82a-4084-80e1-73ffc3c5d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.517047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e0f8-a82a-4084-80e1-73ffc3c5d3cd None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.518231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83e0f8-a82a-4084-80e1-73ffc3c5d3cd None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.519695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83e0f8-a82a-4084-80e1-73ffc3c5d3cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.521445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 95/181] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:48.522629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887febac-1c74-4b37-9455-136e3892b1fd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.522913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887febac-1c74-4b37-9455-136e3892b1fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.523195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887febac-1c74-4b37-9455-136e3892b1fd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.524428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 96/182] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:48.527979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887febac-1c74-4b37-9455-136e3892b1fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.568781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 87/183] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:48.570185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733daa2-6699-4812-b194-24491924d9a5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.570476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733daa2-6699-4812-b194-24491924d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.570755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733daa2-6699-4812-b194-24491924d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.586380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3733daa2-6699-4812-b194-24491924d9a5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:48.587566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3733daa2-6699-4812-b194-24491924d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:48.619617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.630546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887febac-1c74-4b37-9455-136e3892b1fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.652835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 88/184] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:48.653696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733daa2-6699-4812-b194-24491924d9a5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.675574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.676502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.677013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.677565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.679378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:48.679695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.681120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.681742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.689657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 97/185] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:48.690449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.757085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733daa2-6699-4812-b194-24491924d9a5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.790190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ccef4-bccd-4599-9dcf-71496ce4db5f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.792291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.793055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.793339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.793615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.794441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=36355df14fad4dcd961c46ca0b125496, user.id=d303ee7e56ab47ceaf4c6157d31aa0f1) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:48.794750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.796195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.802302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 89/186] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/role_assignments?user.id=d303ee7e56ab47ceaf4c6157d31aa0f1&scope.project.id=36355df14fad4dcd961c46ca0b125496&role.id=d428254d31484e108ec67491b911bc1f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:48.810368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.825714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3f56e-464c-4339-aee4-d1f1baf9d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.826560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f56e-464c-4339-aee4-d1f1baf9d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.826874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f56e-464c-4339-aee4-d1f1baf9d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.827119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f56e-464c-4339-aee4-d1f1baf9d7d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.843524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3f56e-464c-4339-aee4-d1f1baf9d7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9bb3f56e-464c-4339-aee4-d1f1baf9d7d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:48.853898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:48.854913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:48.855829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 98/187] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:48.856497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8c621-77e5-422b-8eee-8779be03190a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.857822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8c621-77e5-422b-8eee-8779be03190a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.857822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8c621-77e5-422b-8eee-8779be03190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.876325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4df8c621-77e5-422b-8eee-8779be03190a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:48.877625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4df8c621-77e5-422b-8eee-8779be03190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:48.889441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.914261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:48.932008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085299-e958-4f4f-82d8-350a6484c893 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.964843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 99/188] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:48.964843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8c621-77e5-422b-8eee-8779be03190a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.980006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.980672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.980991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.981272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.982111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] RBAC: Adding query filter params (role.id=1be9be19909c40699636c4973a021627, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=d303ee7e56ab47ceaf4c6157d31aa0f1) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:48.982425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.983885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.991200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 90/189] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/role_assignments?user.id=d303ee7e56ab47ceaf4c6157d31aa0f1&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=1be9be19909c40699636c4973a021627 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:48.991900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.108779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8c621-77e5-422b-8eee-8779be03190a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.122796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3016ac3-bcdf-459c-8d4c-a6c047d35684 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.149512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.150479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.150769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.151056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.152250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.153756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.155793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 100/190] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:49.156571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.160964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.161778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.162108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.162427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.163651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.165306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.166936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 91/191] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:49.171456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.179899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.194124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.273514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbed2d-81e5-44b6-aad2-49df6775d13f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.282902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c675d-da34-4868-a4b1-a7ac2e07c2c6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.307918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.308787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.309100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.309377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] PATH_INFO: `/v3/users/b20715d3ac104ef887fb8554c90ef06d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.316210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.316904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.317194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.317472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.318221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:49.318562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.319958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.323232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b20715d3ac104ef887fb8554c90ef06d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.324676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.326403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 101/192] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/users/b20715d3ac104ef887fb8554c90ef06d => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:49.327165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.328183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 92/193] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:49.328869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.398270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.411952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7332-5446-4eed-89a7-742be9a691c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.432075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571bb0-a7cf-4c53-ab0d-3521fa822015 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.462333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.463128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.463408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.463691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.465098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.465860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.466254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.466641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.467487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=d303ee7e56ab47ceaf4c6157d31aa0f1) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:49.467809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.469518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.473793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:49.476020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 93/194] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/role_assignments?user.id=d303ee7e56ab47ceaf4c6157d31aa0f1&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=d428254d31484e108ec67491b911bc1f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:49.476916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:49.482826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:49.483875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:49.484784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 102/195] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:49.485615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.601429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621b501-953a-4dea-86da-5ca37108bada None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.606278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f4ee-259a-40ac-b489-8b4a42481957 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.635075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.644135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.644491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.644616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.644801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.645098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.645296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.647008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.647008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.647256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.648605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.668081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.676875 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 94/196] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:49 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:49.676875 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.744535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.746105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.809051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9889c8-ccc8-4371-ba69-2d9c59e5a5e1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.850752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:49.851870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.852053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.853049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] PATH_INFO: `/v3/users/b20715d3ac104ef887fb8554c90ef06d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.854325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] RBAC: Authorizing `identity:get_user(user_id=b20715d3ac104ef887fb8554c90ef06d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:49.855792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:49.857667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 95/197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/users/b20715d3ac104ef887fb8554c90ef06d => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:49.858361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.865294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 103/198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:49.866360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:49.899896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.943056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:49.987428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c984a-b256-4e95-b056-8f0b9ae13d66 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:49.995676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c380d-29a6-4e4c-bd5f-48c658e71d42 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.027568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.028250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.028542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.029197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.029686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:50.030004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.031818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.036226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.037372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.037372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.037670 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.040887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 96/199] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.041558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.116255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.118421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.150607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.153408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778feaf3-ae41-40fe-9624-b13044748746 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.184186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.191097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.192001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.192254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.192539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.194334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.195811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.197584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 97/200] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.198373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.230149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 104/201] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:50.231329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.312888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9eb06-4fa8-43e7-a856-56f637b65109 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.350743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.351775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.352064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.352348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] PATH_INFO: `/v3/users/c2548b49e0ce43318e9ffa0ae8efa3cc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.353270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555faf0c-5be3-4293-83b3-3fed5403589f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.353650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] RBAC: Authorizing `identity:get_user(user_id=c2548b49e0ce43318e9ffa0ae8efa3cc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.355098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.357132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 98/202] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/users/c2548b49e0ce43318e9ffa0ae8efa3cc => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.357573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.393342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.402643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.404017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.404487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.405383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.406719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=b20715d3ac104ef887fb8554c90ef06d) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:50.407269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.409532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.416568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 105/203] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/role_assignments?user.id=b20715d3ac104ef887fb8554c90ef06d&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.417410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.439500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.483814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a99f46-9ef4-47dc-81db-7f818777febc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.530166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.531048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.531346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.531631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.532883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.534369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.537154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 99/204] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.548843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.559331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0211e7-f11b-4e90-af81-b4f2430c1c09 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.612404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.613166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.613459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.613741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.689281 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.690833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.700091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.799617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 106/205] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:50.805022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.829494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb6c2-9536-4225-bc62-67b976545950 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.893569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.894252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.894541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.894820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.895670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] RBAC: Adding query filter params (role.id=1be9be19909c40699636c4973a021627, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=b20715d3ac104ef887fb8554c90ef06d) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:50.895984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.897675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.899703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.903273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.904117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 100/206] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/role_assignments?user.id=b20715d3ac104ef887fb8554c90ef06d&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=1be9be19909c40699636c4973a021627 => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.918989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579fc01-759e-4593-a1f0-f3c20e0a47b3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.977908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2480d-ead2-48ef-9fe7-25e57757b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.978695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2480d-ead2-48ef-9fe7-25e57757b3ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.978985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2480d-ead2-48ef-9fe7-25e57757b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.979270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2480d-ead2-48ef-9fe7-25e57757b3ac None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.980475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2480d-ead2-48ef-9fe7-25e57757b3ac None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.981978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2480d-ead2-48ef-9fe7-25e57757b3ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.984071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 107/207] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.989959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:51.152443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cb050-03d2-47af-bb5b-1718dfeaaa0b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:51.199928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548355b-edce-40cb-ad1b-a1afd7b81bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:51.200594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548355b-edce-40cb-ad1b-a1afd7b81bcb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.200907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548355b-edce-40cb-ad1b-a1afd7b81bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.201193 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548355b-edce-40cb-ad1b-a1afd7b81bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.202036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548355b-edce-40cb-ad1b-a1afd7b81bcb None admin] RBAC: Adding query filter params (role.id=3e5863fab95146c0a8f915731b4174e3, scope.project.id=ab2ef030d9f2488986abf43273a1dee2, user.id=c2548b49e0ce43318e9ffa0ae8efa3cc) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:51.202349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548355b-edce-40cb-ad1b-a1afd7b81bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:51.203805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548355b-edce-40cb-ad1b-a1afd7b81bcb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.211062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 101/208] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/role_assignments?user.id=c2548b49e0ce43318e9ffa0ae8efa3cc&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=3e5863fab95146c0a8f915731b4174e3 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:52.035185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5bd9a-1ea2-4c75-83a4-1f3bafb31ab6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.036222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5bd9a-1ea2-4c75-83a4-1f3bafb31ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.036715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5bd9a-1ea2-4c75-83a4-1f3bafb31ab6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.039404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 108/209] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:52.045110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c6aa-47c3-4a9b-953c-ecb49fc14503 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.046040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c6aa-47c3-4a9b-953c-ecb49fc14503 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.046532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c6aa-47c3-4a9b-953c-ecb49fc14503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.063646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b243c6aa-47c3-4a9b-953c-ecb49fc14503 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:52.065185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b243c6aa-47c3-4a9b-953c-ecb49fc14503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:52.122585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1b9c-3f6d-4646-85bb-4b5db353dd76 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.123247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1b9c-3f6d-4646-85bb-4b5db353dd76 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.123735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1b9c-3f6d-4646-85bb-4b5db353dd76 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.125395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 109/210] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:52.129418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.132522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acef92-88b5-461d-9e37-0798b765478e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.133100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acef92-88b5-461d-9e37-0798b765478e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.133645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acef92-88b5-461d-9e37-0798b765478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.140476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 102/211] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:52.152542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3acef92-88b5-461d-9e37-0798b765478e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:52.154040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3acef92-88b5-461d-9e37-0798b765478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:52.163787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243c6aa-47c3-4a9b-953c-ecb49fc14503 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.229185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 110/212] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:52.260271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acef92-88b5-461d-9e37-0798b765478e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.293315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243c6aa-47c3-4a9b-953c-ecb49fc14503 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.339258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.340575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.341296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.342512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.357392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:52.364244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:52.366164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:52.367745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:52.368550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 103/213] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:52.375744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.379882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acef92-88b5-461d-9e37-0798b765478e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.425054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.425819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.426106 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.429070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.430531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.432691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.439881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 111/214] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:52.440959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.451284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.506637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8065-1e03-4f32-b764-bdd217338a1e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.544913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.545369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.545662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.545942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.546774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:52.547010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.548586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.555605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05489-14e6-4829-b862-58c1ec76a5b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.559871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 104/215] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:52.565654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.594224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.595145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.595609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.596047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.597051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.598774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.623911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 112/216] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:52 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:04:52.699449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db72cf-4ebe-472f-b454-25f65581e95b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.716227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.745379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c4c6-770a-4417-accf-c994f953f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.746289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c4c6-770a-4417-accf-c994f953f25b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.746631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c4c6-770a-4417-accf-c994f953f25b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.746916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c4c6-770a-4417-accf-c994f953f25b None admin] PATH_INFO: `/v3/users/c8d655fb0e404974bf20460b398f3ba9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.762860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c4c6-770a-4417-accf-c994f953f25b None admin] RBAC: Authorizing `identity:get_user(user_id=c8d655fb0e404974bf20460b398f3ba9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.764424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c4c6-770a-4417-accf-c994f953f25b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.766254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 105/217] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/users/c8d655fb0e404974bf20460b398f3ba9 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:52.772562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.793636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.884362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274844dc-973a-449b-89aa-04caec4740c3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.920070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.920748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.921072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.921418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.985273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0393b05-6360-4192-8a4a-95d42f9adca9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.985922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0393b05-6360-4192-8a4a-95d42f9adca9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.986444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0393b05-6360-4192-8a4a-95d42f9adca9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.988100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 106/218] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:52.995629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a09de0-9662-4d56-a914-8c672c4e526f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.995924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a09de0-9662-4d56-a914-8c672c4e526f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.996213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a09de0-9662-4d56-a914-8c672c4e526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.000445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.001935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.026505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.027890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a1a09de0-9662-4d56-a914-8c672c4e526f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:53.030176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a1a09de0-9662-4d56-a914-8c672c4e526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:53.122908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 107/219] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:53.124996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344f4e-ac3f-4211-9ce1-5b75eb416f45 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.125125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 113/220] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:53.125650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344f4e-ac3f-4211-9ce1-5b75eb416f45 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.125650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344f4e-ac3f-4211-9ce1-5b75eb416f45 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.126999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 108/221] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:53.130539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.132501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6cdd-59b4-418d-b688-4a4b62e01946 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.132799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6cdd-59b4-418d-b688-4a4b62e01946 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.133187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf6cdd-59b4-418d-b688-4a4b62e01946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.153010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-54bf6cdd-59b4-418d-b688-4a4b62e01946 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:53.154304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-54bf6cdd-59b4-418d-b688-4a4b62e01946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:53.241858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30f474-06f1-4c71-ac8a-368e69ca3cc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.246485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 109/222] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:53.247353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf6cdd-59b4-418d-b688-4a4b62e01946 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.261523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.284358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.285601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.286549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.287701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.290089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.292405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.295014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 114/223] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:53.295967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.304131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.394656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf6cdd-59b4-418d-b688-4a4b62e01946 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.432741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.433616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.433983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.434320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.438963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32bfa-0542-4c0f-bd0b-02cac24abd77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.446722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:53.454866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:53.455764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:53.456561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 110/224] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:53.457388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.488084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.489829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.490939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.491386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.506709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:53.518291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:53.519423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:53.520436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:53.523514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 115/225] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:53.524487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.570014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.580502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120114d-6271-4175-85b0-2a433a9687dc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.589132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.620809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.621966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.622402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.622785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.623880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=c8d655fb0e404974bf20460b398f3ba9) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:53.624252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.625861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.632753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 111/226] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/role_assignments?user.id=c8d655fb0e404974bf20460b398f3ba9&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=d428254d31484e108ec67491b911bc1f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.637840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.660664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e9927-fcc1-4c5b-8b42-df5d0b4ef3ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.703280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.704369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.704834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.705269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.706633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:53.707105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.709594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.720495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 116/227] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.725719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.848807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b999a-c31f-4edc-9f19-c05771fdf933 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.861216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.891028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.891922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.892207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.892489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] PATH_INFO: `/v3/users/b20715d3ac104ef887fb8554c90ef06d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.893752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] RBAC: Authorizing `identity:get_user(user_id=b20715d3ac104ef887fb8554c90ef06d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.895211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.897897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 117/228] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/users/b20715d3ac104ef887fb8554c90ef06d => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.905018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.910182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed866e9-3292-4ff4-9f38-f0ac57cb08c1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.990805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.991550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.991845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.992130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.993179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:53.993495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.994904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.013942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 112/229] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.020581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929672e-9d1e-421a-8991-e35e06f855ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.022932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.061141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.062021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.062314 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.062599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.063869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.065514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.067606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 118/230] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.069289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.073762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.154467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.205132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d866-efe1-4988-9699-2014cd14e48f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.219869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97af4f-0b06-4d3e-a0e3-72ea58fd0bd5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.252966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.254585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.255244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.255884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] PATH_INFO: `/v3/users/b20715d3ac104ef887fb8554c90ef06d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.257463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.257753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=b20715d3ac104ef887fb8554c90ef06d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.258427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.258717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.259004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/b20715d3ac104ef887fb8554c90ef06d/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.260158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.261171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] RBAC: Authorizing `identity:create_grant(project_id=5987f6dac2ef4657891f4fdf482bda82, user_id=b20715d3ac104ef887fb8554c90ef06d, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.268868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.269344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 113/231] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/users/b20715d3ac104ef887fb8554c90ef06d => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.275794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.285699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 119/232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:54 2022] PUT /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/b20715d3ac104ef887fb8554c90ef06d/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:54.422990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.447214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcc055-8113-4413-896e-5a619dbe0fc3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.487995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d1376-a48f-40fb-9af4-8525f6441d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.489141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1376-a48f-40fb-9af4-8525f6441d42 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.489595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1376-a48f-40fb-9af4-8525f6441d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.490018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1376-a48f-40fb-9af4-8525f6441d42 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.491548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d1376-a48f-40fb-9af4-8525f6441d42 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.493515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d1376-a48f-40fb-9af4-8525f6441d42 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.495371 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 114/233] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:54.501492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.617743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada20651-8be0-46cd-9102-2b5f145c4b7d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.619357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.664878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27385a-27b6-475f-a8a1-5d61f58725e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.665785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27385a-27b6-475f-a8a1-5d61f58725e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.666074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27385a-27b6-475f-a8a1-5d61f58725e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.666426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27385a-27b6-475f-a8a1-5d61f58725e9 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/b20715d3ac104ef887fb8554c90ef06d/roles/1be9be19909c40699636c4973a021627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.668722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27385a-27b6-475f-a8a1-5d61f58725e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5987f6dac2ef4657891f4fdf482bda82, user_id=b20715d3ac104ef887fb8554c90ef06d, role_id=1be9be19909c40699636c4973a021627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.670232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27385a-27b6-475f-a8a1-5d61f58725e9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.686333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 120/234] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:54 2022] PUT /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/b20715d3ac104ef887fb8554c90ef06d/roles/1be9be19909c40699636c4973a021627 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:55.194759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca6af-f1e0-4975-9b68-6847ed1c5f1e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.195155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca6af-f1e0-4975-9b68-6847ed1c5f1e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.195335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca6af-f1e0-4975-9b68-6847ed1c5f1e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.196700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 115/235] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:55.202082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f160c3-435f-493e-b081-e2f3b1b25137 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.202552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f160c3-435f-493e-b081-e2f3b1b25137 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.202629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f160c3-435f-493e-b081-e2f3b1b25137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.225847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-56f160c3-435f-493e-b081-e2f3b1b25137 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:55.227078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-56f160c3-435f-493e-b081-e2f3b1b25137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:55.315316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 121/236] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:55.328309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6502496-803b-4ef3-ad10-037315fb4111 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.329226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6502496-803b-4ef3-ad10-037315fb4111 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.329711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6502496-803b-4ef3-ad10-037315fb4111 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.331540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 116/237] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:55.336884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273617e-ff20-483a-ac10-55e604c556af None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.337187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273617e-ff20-483a-ac10-55e604c556af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.337475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273617e-ff20-483a-ac10-55e604c556af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.343801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6502496-803b-4ef3-ad10-037315fb4111 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.358424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f273617e-ff20-483a-ac10-55e604c556af None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:55.364845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f273617e-ff20-483a-ac10-55e604c556af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:55.482365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 122/238] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:55.512024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6502496-803b-4ef3-ad10-037315fb4111 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.524104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273617e-ff20-483a-ac10-55e604c556af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.568371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:55.573283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.574383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.574888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.575404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.588895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:55.598088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:55.598971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:55.600376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:55.602737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 117/239] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:55.608506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.649184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:55.732551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273617e-ff20-483a-ac10-55e604c556af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.776207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1e5b-eedf-4862-aa9b-c409c73008ed None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.799438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.800480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.801004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.802358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.804011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:55.806400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:55.808346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 123/240] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:55.815837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.847063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.847998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.848407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.848806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.850592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:55.851122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:55.852726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:55.868458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 118/241] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:55.876079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.987850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:55.990667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.014947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47dfd9-1467-4b90-b03f-14579410e81e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.017060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d51dd5-fe86-4c33-aa44-e11cd14d0cc1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.056001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.057272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.057773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.058256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] PATH_INFO: `/v3/users/5b28442b83b1472aa788bef7f8c68f23` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.074236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=5b28442b83b1472aa788bef7f8c68f23)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.076420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.078654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 119/242] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/users/5b28442b83b1472aa788bef7f8c68f23 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:56.085077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:56.117793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356c9d1-355a-4b7a-aed0-25c94eebdb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.118490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356c9d1-355a-4b7a-aed0-25c94eebdb87 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.118773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356c9d1-355a-4b7a-aed0-25c94eebdb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.119047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356c9d1-355a-4b7a-aed0-25c94eebdb87 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.120007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356c9d1-355a-4b7a-aed0-25c94eebdb87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.121246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356c9d1-355a-4b7a-aed0-25c94eebdb87 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.163526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 124/243] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:55 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:56.210561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43711494-05d0-4c79-b770-31bd9c20e0f9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.250021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.251079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.251583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.252106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.255328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.329195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.331495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.333850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793d6b-8e4d-481c-9827-47c167ee6f59 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.334385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793d6b-8e4d-481c-9827-47c167ee6f59 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.334699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793d6b-8e4d-481c-9827-47c167ee6f59 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.336550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 125/244] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:56.341605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb132b0-9ed1-4bd4-b19b-74ec368994c7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.341901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb132b0-9ed1-4bd4-b19b-74ec368994c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.342796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb132b0-9ed1-4bd4-b19b-74ec368994c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.374081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cdb132b0-9ed1-4bd4-b19b-74ec368994c7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:56.375319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cdb132b0-9ed1-4bd4-b19b-74ec368994c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:56.476248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 120/245] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:56.477463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:56.495000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 126/246] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:56.516207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.519294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb132b0-9ed1-4bd4-b19b-74ec368994c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:56.601781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854956ca-dd9e-4f96-b8f2-b9f2026d6892 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.622216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.654685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.655893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.656400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.656867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb132b0-9ed1-4bd4-b19b-74ec368994c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.657121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.659573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.661322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.664925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 121/247] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:56.686800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:56.703909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.704903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.705184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.705464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.721623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:56.734258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:56.735193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:56.735978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:56.738422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 127/248] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:56.746207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:56.827898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768adb4d-b3b9-4a13-9fa9-5a61b5e3ef02 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.830362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.875886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba012c2-9358-4f1e-ac8d-552eb176611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.876446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf76a7-ff1b-4cd6-a3b6-89e985c38005 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.876554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba012c2-9358-4f1e-ac8d-552eb176611d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.876852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba012c2-9358-4f1e-ac8d-552eb176611d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.877139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba012c2-9358-4f1e-ac8d-552eb176611d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.877983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba012c2-9358-4f1e-ac8d-552eb176611d None admin] RBAC: Adding query filter params (role.id=3e5863fab95146c0a8f915731b4174e3, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=5b28442b83b1472aa788bef7f8c68f23) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:56.878341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba012c2-9358-4f1e-ac8d-552eb176611d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.879994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba012c2-9358-4f1e-ac8d-552eb176611d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.887008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 122/249] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/role_assignments?user.id=5b28442b83b1472aa788bef7f8c68f23&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=3e5863fab95146c0a8f915731b4174e3 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:56.888326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e136116-beca-441b-9975-56d7879e2da8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.888572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e136116-beca-441b-9975-56d7879e2da8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.888892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e136116-beca-441b-9975-56d7879e2da8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.891520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 123/250] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:56.896106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50ccd-9216-45dc-bb0e-1838cb65996f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.897037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50ccd-9216-45dc-bb0e-1838cb65996f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.897308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50ccd-9216-45dc-bb0e-1838cb65996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.918018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.918730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.919013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.919180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5ed50ccd-9216-45dc-bb0e-1838cb65996f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:56.919274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.920063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:56.920349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.920445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5ed50ccd-9216-45dc-bb0e-1838cb65996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:56.921820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.925047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.935425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 128/251] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:56.941956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.012298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 124/252] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:57.045782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed50ccd-9216-45dc-bb0e-1838cb65996f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.085480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5389c7-85e8-4134-9dfa-e51ee465f5f8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.138470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698660f-458f-4923-a41f-03a225251131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.139417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698660f-458f-4923-a41f-03a225251131 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.139663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698660f-458f-4923-a41f-03a225251131 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.139926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698660f-458f-4923-a41f-03a225251131 None admin] PATH_INFO: `/v3/users/c8d655fb0e404974bf20460b398f3ba9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698660f-458f-4923-a41f-03a225251131 None admin] RBAC: Authorizing `identity:get_user(user_id=c8d655fb0e404974bf20460b398f3ba9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.142752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698660f-458f-4923-a41f-03a225251131 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.146249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 129/253] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/users/c8d655fb0e404974bf20460b398f3ba9 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:57.159736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698660f-458f-4923-a41f-03a225251131 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.217925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.238340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed50ccd-9216-45dc-bb0e-1838cb65996f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.296623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.315767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.316577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.316883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.317166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.330705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:57.339515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:57.340390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:57.341968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 125/254] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:57.350937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.372779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698660f-458f-4923-a41f-03a225251131 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.446906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb836e4-b330-4046-a406-ef97400c1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.450535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb836e4-b330-4046-a406-ef97400c1815 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.451055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb836e4-b330-4046-a406-ef97400c1815 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.451586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb836e4-b330-4046-a406-ef97400c1815 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.453519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb836e4-b330-4046-a406-ef97400c1815 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.456714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb836e4-b330-4046-a406-ef97400c1815 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.461508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 130/255] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:57.468115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e9e2-b0d2-4584-983f-d96965488528 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.472545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e9e2-b0d2-4584-983f-d96965488528 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.473093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e9e2-b0d2-4584-983f-d96965488528 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.475321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 131/256] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:57.481707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e9e2-b0d2-4584-983f-d96965488528 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.518704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fac22-3013-4963-acba-8d8a99e41606 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.603529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01429-e0bf-4075-a70d-ac09fc4be57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.607613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01429-e0bf-4075-a70d-ac09fc4be57f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.607752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01429-e0bf-4075-a70d-ac09fc4be57f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.608005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01429-e0bf-4075-a70d-ac09fc4be57f None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.608769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01429-e0bf-4075-a70d-ac09fc4be57f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:57.609102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01429-e0bf-4075-a70d-ac09fc4be57f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.610519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01429-e0bf-4075-a70d-ac09fc4be57f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.627444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 126/257] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:57.628712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b297a-2e54-4a56-971b-a95999b4e689 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.629024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b297a-2e54-4a56-971b-a95999b4e689 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.629302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b297a-2e54-4a56-971b-a95999b4e689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.665703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-368b297a-2e54-4a56-971b-a95999b4e689 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:57.669024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-368b297a-2e54-4a56-971b-a95999b4e689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:57.670518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e9e2-b0d2-4584-983f-d96965488528 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.702512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.723674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.725127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.725590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.726137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/c8d655fb0e404974bf20460b398f3ba9/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.728178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] RBAC: Authorizing `identity:create_grant(project_id=5987f6dac2ef4657891f4fdf482bda82, user_id=c8d655fb0e404974bf20460b398f3ba9, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.729610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.733804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.750803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 132/258] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:57 2022] PUT /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/c8d655fb0e404974bf20460b398f3ba9/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:57.755927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.823282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 127/259] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:57.865760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b297a-2e54-4a56-971b-a95999b4e689 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.941545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacba77-196c-413d-9ec7-40c39495377a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.001738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b297a-2e54-4a56-971b-a95999b4e689 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.013309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.016846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.016846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.016846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] PATH_INFO: `/v3/users/b20715d3ac104ef887fb8554c90ef06d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.016846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] RBAC: Authorizing `identity:get_user(user_id=b20715d3ac104ef887fb8554c90ef06d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.018140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.020416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 133/260] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/users/b20715d3ac104ef887fb8554c90ef06d => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:58.027089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.070859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.072082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.073881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.074372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.105820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:58.117733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:58.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:58.119512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:04:58.131194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 128/261] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:58.136978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.154987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.160566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.222959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cc59d-7bc7-495a-b149-64d341039540 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.275537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.276321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.276619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.276935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.335902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cca51-0432-40df-9a3c-493acca4ecd0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.392433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.393894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.397227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.398240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.398746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.399222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.400196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:58.400706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.407083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.424334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 129/262] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:58.429990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.495305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.538802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.577209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700efd29-2f83-4b8b-8017-522bd447bc47 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.578251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 134/263] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:58.585638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.624165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.625428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.626193 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.626672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] PATH_INFO: `/v3/users/b20715d3ac104ef887fb8554c90ef06d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.628406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] RBAC: Authorizing `identity:get_user(user_id=b20715d3ac104ef887fb8554c90ef06d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.630112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.632467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 130/264] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/users/b20715d3ac104ef887fb8554c90ef06d => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:58.637602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.748135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14634f-4f46-4a61-b3c4-d94ad98cae77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.785801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.786666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.786989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.787269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.788646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.790785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.792474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 135/265] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:58.801246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9d131-7a58-49bd-bc52-65d7005a3537 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.805724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.863452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.872619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.873587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.873872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.874153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.891223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.997131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bcc1-dad2-42dc-bbd7-a68dbb7711b8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.017912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.019406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.046520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.047198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.047482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.047757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.048601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=b20715d3ac104ef887fb8554c90ef06d) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:59.048941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.050395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.072241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 136/266] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/role_assignments?user.id=b20715d3ac104ef887fb8554c90ef06d&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:59.177096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 131/267] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:59.184862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.342698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.356705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2d4f2-20f8-47c2-8461-180e45487115 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.401746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bbbf1-99a6-4f7a-9443-63f02c4b08bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.402634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bbbf1-99a6-4f7a-9443-63f02c4b08bf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.402923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bbbf1-99a6-4f7a-9443-63f02c4b08bf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.403207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bbbf1-99a6-4f7a-9443-63f02c4b08bf None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.409559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bbbf1-99a6-4f7a-9443-63f02c4b08bf None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.411043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bbbf1-99a6-4f7a-9443-63f02c4b08bf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.413192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 137/268] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:59.419129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.449179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95be7-2ae0-4913-8cba-d46382ab9724 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.449501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95be7-2ae0-4913-8cba-d46382ab9724 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.449752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95be7-2ae0-4913-8cba-d46382ab9724 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.451410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 138/269] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:59.457609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37915360-b6ee-4237-bb87-8961c4816507 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.457901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37915360-b6ee-4237-bb87-8961c4816507 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.458184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37915360-b6ee-4237-bb87-8961c4816507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.491398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-37915360-b6ee-4237-bb87-8961c4816507 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:59.492862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-37915360-b6ee-4237-bb87-8961c4816507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:59.493384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.606284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc08a1-9231-4e80-b880-f4a419c5c7b4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.621552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 139/270] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:59.650291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55be0d-5b51-4485-aa92-edc656c941d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.651715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55be0d-5b51-4485-aa92-edc656c941d6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.652172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55be0d-5b51-4485-aa92-edc656c941d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.652610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55be0d-5b51-4485-aa92-edc656c941d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.653663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55be0d-5b51-4485-aa92-edc656c941d6 None admin] RBAC: Adding query filter params (role.id=1be9be19909c40699636c4973a021627, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=b20715d3ac104ef887fb8554c90ef06d) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:59.654139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55be0d-5b51-4485-aa92-edc656c941d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.655794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55be0d-5b51-4485-aa92-edc656c941d6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.662905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 132/271] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/role_assignments?user.id=b20715d3ac104ef887fb8554c90ef06d&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=1be9be19909c40699636c4973a021627 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:59.682039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37915360-b6ee-4237-bb87-8961c4816507 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.827034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.839841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37915360-b6ee-4237-bb87-8961c4816507 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.884284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99303c3-cd1d-4c4a-8d58-1322c2b5ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.885039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99303c3-cd1d-4c4a-8d58-1322c2b5ca30 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.885328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99303c3-cd1d-4c4a-8d58-1322c2b5ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.885610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99303c3-cd1d-4c4a-8d58-1322c2b5ca30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.901437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99303c3-cd1d-4c4a-8d58-1322c2b5ca30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:59.905953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214285f-6859-4303-83c2-8cb7bbf42e14 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.906465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214285f-6859-4303-83c2-8cb7bbf42e14 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.906949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214285f-6859-4303-83c2-8cb7bbf42e14 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.908519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 133/272] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c99303c3-cd1d-4c4a-8d58-1322c2b5ca30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:59.909807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:59.910705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:59.911511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:04:59.915828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 140/273] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:59.916926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214285f-6859-4303-83c2-8cb7bbf42e14 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.918625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a559fa8-8061-4c7e-bd56-987dea99e8e5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.918923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a559fa8-8061-4c7e-bd56-987dea99e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.919210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a559fa8-8061-4c7e-bd56-987dea99e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.936730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6a559fa8-8061-4c7e-bd56-987dea99e8e5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:59.937987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6a559fa8-8061-4c7e-bd56-987dea99e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:00.026175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 141/274] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:00.038450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995d00e-2ede-433b-a1b4-d36058e2bcc0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.038753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995d00e-2ede-433b-a1b4-d36058e2bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.039020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995d00e-2ede-433b-a1b4-d36058e2bcc0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.044198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 142/275] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:00.045417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f064f-d123-41b1-8d35-c82be39498d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.045702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f064f-d123-41b1-8d35-c82be39498d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.045980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f064f-d123-41b1-8d35-c82be39498d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.063605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-483f064f-d123-41b1-8d35-c82be39498d0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:00.064770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-483f064f-d123-41b1-8d35-c82be39498d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:00.073178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214285f-6859-4303-83c2-8cb7bbf42e14 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.075043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.110721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.111391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.111675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.111951 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.112691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:00.113100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.114469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.125109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 134/276] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:00.125911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.143079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 143/277] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:00.143862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f064f-d123-41b1-8d35-c82be39498d0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.159131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.243299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111247-5362-4e7c-86a7-f78840e914cd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.252629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f064f-d123-41b1-8d35-c82be39498d0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.278506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.279375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.279665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.279948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.291013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.291161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:00.291889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.292171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.292445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] PATH_INFO: `/v3/users/d804257d3b344b8cb4a475cc2ad60689` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:00.298984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:00.299873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:00.300660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 135/278] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:00.302259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.308383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] RBAC: Authorizing `identity:get_user(user_id=d804257d3b344b8cb4a475cc2ad60689)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.309896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.311834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 144/279] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/users/d804257d3b344b8cb4a475cc2ad60689 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:00.313544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.330213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.391134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.414103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c2d3-1856-452b-9fa0-62743ada5256 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.425731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2acac-757b-416a-ae0e-7591004d3d7c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.451047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.451939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.452186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.452470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.453728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.455202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.461010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 136/280] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:00.461010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.467595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.468280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.468566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.468873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.469631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:00.469941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.471745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.486493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 145/281] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:00.486493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.563435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.573983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a047b-6e6c-4b56-9422-1d9ac7d26183 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.595970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b49d-602c-4714-901b-6ec987170844 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.608310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.608987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.609275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.609548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.610376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, user.id=d804257d3b344b8cb4a475cc2ad60689, scope.system=all) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:00.610686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.612127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.617995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 137/282] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/role_assignments?user.id=d804257d3b344b8cb4a475cc2ad60689&scope.system=all&role.id=d428254d31484e108ec67491b911bc1f => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:00.618763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.626456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.632331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f5f7-45bd-49ad-963f-4bb400a90907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.633071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f5f7-45bd-49ad-963f-4bb400a90907 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.633371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f5f7-45bd-49ad-963f-4bb400a90907 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.633660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f5f7-45bd-49ad-963f-4bb400a90907 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.634402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f5f7-45bd-49ad-963f-4bb400a90907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.635923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f5f7-45bd-49ad-963f-4bb400a90907 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.661777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 146/283] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:00 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:00.671585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49426e89-a1d8-4a51-aedc-086605f12b90 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.672227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49426e89-a1d8-4a51-aedc-086605f12b90 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.673158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49426e89-a1d8-4a51-aedc-086605f12b90 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.681739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 147/284] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:00.685179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255da6-a14a-4d03-953d-18285e056042 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.685490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255da6-a14a-4d03-953d-18285e056042 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.685748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255da6-a14a-4d03-953d-18285e056042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.714655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c9255da6-a14a-4d03-953d-18285e056042 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:00.717336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c9255da6-a14a-4d03-953d-18285e056042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:00.766933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900725e5-0088-4229-9aff-939409ea7d0a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.813509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.814581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.814869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.815148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] PATH_INFO: `/v3/users/5b28442b83b1472aa788bef7f8c68f23` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.817057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] RBAC: Authorizing `identity:get_user(user_id=5b28442b83b1472aa788bef7f8c68f23)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.818972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.820753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 138/285] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/users/5b28442b83b1472aa788bef7f8c68f23 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:00.821559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 148/286] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:00.825797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.846300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9255da6-a14a-4d03-953d-18285e056042 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.856731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.975271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390549-de06-46e7-af24-2545e8244951 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.985259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9255da6-a14a-4d03-953d-18285e056042 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.012055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.023339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.025390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.025390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.025773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.027105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.028681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.032893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 139/287] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:01.036108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.037684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.037684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.037958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.039220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.049371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:01.058471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:01.059443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:01.060252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 149/288] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:01.067244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.159833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.173243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4c334-d300-4606-aadf-4fa684475aa6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.211789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e200-5131-467c-a8b5-c061bc2b62dd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.213310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.214378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.214726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.215094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/5b28442b83b1472aa788bef7f8c68f23/roles/3e5863fab95146c0a8f915731b4174e3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.217417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5987f6dac2ef4657891f4fdf482bda82, user_id=5b28442b83b1472aa788bef7f8c68f23, role_id=3e5863fab95146c0a8f915731b4174e3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.218954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.240102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 140/289] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:01 2022] PUT /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82/users/5b28442b83b1472aa788bef7f8c68f23/roles/3e5863fab95146c0a8f915731b4174e3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:01.262002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.262942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.263376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.263804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.264745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:01.265238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.266821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.278136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 150/290] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:01.284138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.418564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04ce6-7441-4703-9be1-2ec13819d4d0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.467702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.469354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.469792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.470222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] PATH_INFO: `/v3/users/c8d655fb0e404974bf20460b398f3ba9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.477819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] RBAC: Authorizing `identity:get_user(user_id=c8d655fb0e404974bf20460b398f3ba9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.479575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.481553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 141/291] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/users/c8d655fb0e404974bf20460b398f3ba9 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:01.487369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.536118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.602005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aefa1-df75-4bd5-af9c-4aa75a96e778 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.637297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.638202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.638641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.639073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.712112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.713636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.755824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.820459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 151/292] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:01.826204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.855348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.953106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7431-1601-43ba-808a-bf7f2164da4a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.006636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ded545-bb6e-4b13-a2e5-24f3c2e283ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.007500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded545-bb6e-4b13-a2e5-24f3c2e283ae None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.007790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded545-bb6e-4b13-a2e5-24f3c2e283ae None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.008076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded545-bb6e-4b13-a2e5-24f3c2e283ae None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.013548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ded545-bb6e-4b13-a2e5-24f3c2e283ae None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.015032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ded545-bb6e-4b13-a2e5-24f3c2e283ae None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.016750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 142/293] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.022823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.129895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983a3d-267e-4c37-9131-e7e1595d6e29 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.165927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1bc3-d7d9-4318-b3b6-5a0cf56fcc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.166589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1bc3-d7d9-4318-b3b6-5a0cf56fcc6b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.166878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1bc3-d7d9-4318-b3b6-5a0cf56fcc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.167162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1bc3-d7d9-4318-b3b6-5a0cf56fcc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.168000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1bc3-d7d9-4318-b3b6-5a0cf56fcc6b None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=c8d655fb0e404974bf20460b398f3ba9) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:02.168317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1bc3-d7d9-4318-b3b6-5a0cf56fcc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.169821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1bc3-d7d9-4318-b3b6-5a0cf56fcc6b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.176055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 152/294] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/role_assignments?user.id=c8d655fb0e404974bf20460b398f3ba9&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=d428254d31484e108ec67491b911bc1f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.973052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd808-6699-4adb-9d95-d3dd311d684c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.974030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd808-6699-4adb-9d95-d3dd311d684c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.974588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd808-6699-4adb-9d95-d3dd311d684c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.976411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 143/295] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:02.981911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33706360-a087-4060-b9e5-3b8bb787fb35 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.982758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33706360-a087-4060-b9e5-3b8bb787fb35 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.983269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33706360-a087-4060-b9e5-3b8bb787fb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.990764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:03.002179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-33706360-a087-4060-b9e5-3b8bb787fb35 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:03.003630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-33706360-a087-4060-b9e5-3b8bb787fb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:03.073573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 153/296] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:03.096789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cd808-6699-4adb-9d95-d3dd311d684c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.189584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:03.203939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cd808-6699-4adb-9d95-d3dd311d684c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.218360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182434-31f3-419c-8139-194ac98548df None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.219004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182434-31f3-419c-8139-194ac98548df None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.219382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182434-31f3-419c-8139-194ac98548df None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.221013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 154/297] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:03.226500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2725db-e3ef-4581-b2f2-ac5d1e1bac31 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.226796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2725db-e3ef-4581-b2f2-ac5d1e1bac31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.227289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2725db-e3ef-4581-b2f2-ac5d1e1bac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.241479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.242859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.243343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.243839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.245149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cf2725db-e3ef-4581-b2f2-ac5d1e1bac31 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:03.246573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cf2725db-e3ef-4581-b2f2-ac5d1e1bac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:03.254903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:03.263689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:03.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:03.265429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 144/298] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:03.270738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.336927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 155/299] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:03.364870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2725db-e3ef-4581-b2f2-ac5d1e1bac31 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.399387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3660a-5688-40b8-80c9-62233215fedf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.442730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860eca9a-aaaa-41c6-ae43-c72e4cdd995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.443952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860eca9a-aaaa-41c6-ae43-c72e4cdd995a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.444779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860eca9a-aaaa-41c6-ae43-c72e4cdd995a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.445580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860eca9a-aaaa-41c6-ae43-c72e4cdd995a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.446694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860eca9a-aaaa-41c6-ae43-c72e4cdd995a None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:03.447220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860eca9a-aaaa-41c6-ae43-c72e4cdd995a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:03.447324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:03.449691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860eca9a-aaaa-41c6-ae43-c72e4cdd995a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:03.461236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 145/300] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:03.463902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b4b3a-385c-495d-98b1-e7721f58d854 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.464450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b4b3a-385c-495d-98b1-e7721f58d854 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.464970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b4b3a-385c-495d-98b1-e7721f58d854 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.466628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 146/301] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:03.467562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b4b3a-385c-495d-98b1-e7721f58d854 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.482946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:03.494727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2725db-e3ef-4581-b2f2-ac5d1e1bac31 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.533634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e7cc-36ac-47d8-bae1-574be743a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.534441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e7cc-36ac-47d8-bae1-574be743a763 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.534813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e7cc-36ac-47d8-bae1-574be743a763 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.535100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e7cc-36ac-47d8-bae1-574be743a763 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.546282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279e7cc-36ac-47d8-bae1-574be743a763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0279e7cc-36ac-47d8-bae1-574be743a763 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:03.554947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:03.555898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 156/302] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:03.563324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3493-2c97-450f-b507-d87a9bd6e8b6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.564788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3493-2c97-450f-b507-d87a9bd6e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.564788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b3493-2c97-450f-b507-d87a9bd6e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.579332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-403b3493-2c97-450f-b507-d87a9bd6e8b6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:03.580558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-403b3493-2c97-450f-b507-d87a9bd6e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:03.583468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b4b3a-385c-495d-98b1-e7721f58d854 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.621552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.622423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.622704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.622980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] PATH_INFO: `/v3/users/d804257d3b344b8cb4a475cc2ad60689` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.624154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d804257d3b344b8cb4a475cc2ad60689)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:03.625621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:03.632023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 147/303] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/users/d804257d3b344b8cb4a475cc2ad60689 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:03.632023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.661570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 157/304] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:03.663344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3493-2c97-450f-b507-d87a9bd6e8b6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.726242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:03.728700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:03.753357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dd902-31df-4456-902e-e0799c9359d8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.776311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b3493-2c97-450f-b507-d87a9bd6e8b6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.791929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.792448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.792738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.793147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.793801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:03.794113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:03.795576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:03.804335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 148/305] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:03.805751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.812274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e39600-7c07-4c65-a2fc-6b9fac8dac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.813160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39600-7c07-4c65-a2fc-6b9fac8dac07 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.813445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39600-7c07-4c65-a2fc-6b9fac8dac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.813724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39600-7c07-4c65-a2fc-6b9fac8dac07 None admin] PATH_INFO: `/v3/system/users/d804257d3b344b8cb4a475cc2ad60689/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.815194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e39600-7c07-4c65-a2fc-6b9fac8dac07 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d804257d3b344b8cb4a475cc2ad60689, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:03.816566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e39600-7c07-4c65-a2fc-6b9fac8dac07 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:03.826237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 158/306] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Jul 21 04:05:03 2022] PUT /identity/v3/system/users/d804257d3b344b8cb4a475cc2ad60689/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:03.827496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f1ae0-5651-42d1-8be8-5f1291697b33 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.827786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f1ae0-5651-42d1-8be8-5f1291697b33 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.828065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f1ae0-5651-42d1-8be8-5f1291697b33 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.829399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 159/307] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:03.830115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f1ae0-5651-42d1-8be8-5f1291697b33 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.933164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412d13f-a65b-49f7-89dc-f43535d6219b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.953869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f1ae0-5651-42d1-8be8-5f1291697b33 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.971544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103b1d4-acdf-4a62-8e0b-9a8dd163fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.973027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:03.973139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103b1d4-acdf-4a62-8e0b-9a8dd163fdfc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.975739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103b1d4-acdf-4a62-8e0b-9a8dd163fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.975739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103b1d4-acdf-4a62-8e0b-9a8dd163fdfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.977435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103b1d4-acdf-4a62-8e0b-9a8dd163fdfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:03.978628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103b1d4-acdf-4a62-8e0b-9a8dd163fdfc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:03.981419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 149/308] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:03.981761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01a06-d624-4aa3-96b6-5199704cfc8b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.982055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01a06-d624-4aa3-96b6-5199704cfc8b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.982348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01a06-d624-4aa3-96b6-5199704cfc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.997251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.998322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.998611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.998894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] PATH_INFO: `/v3/users/a93de3ff16dc411cb74a6e6aa14b45ba` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:04.001485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a7f01a06-d624-4aa3-96b6-5199704cfc8b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:04.003252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a7f01a06-d624-4aa3-96b6-5199704cfc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:04.004753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:04.016398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] RBAC: Authorizing `identity:get_user(user_id=a93de3ff16dc411cb74a6e6aa14b45ba)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:04.018701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:04.019653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 160/309] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/users/a93de3ff16dc411cb74a6e6aa14b45ba => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:04.025251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:04.081117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 150/310] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:04.081968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01a06-d624-4aa3-96b6-5199704cfc8b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:04.143252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309ca0e-9112-4c58-a5df-99dd297acaab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:04.180318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:04.181029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:04.181318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:04.181599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] PATH_INFO: `/v3/groups` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:04.182303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:04.183759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:04.198713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 161/311] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Jul 21 04:05:04 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:04.199661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:04.214997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01a06-d624-4aa3-96b6-5199704cfc8b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:04.244507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:04.264335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:04.265345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:04.265636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:04.265922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:04.266814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] RBAC: Adding query filter params (role.id=3e5863fab95146c0a8f915731b4174e3, user.id=a93de3ff16dc411cb74a6e6aa14b45ba, scope.system=all) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:04.267139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:04.268655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:04.276060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 151/312] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jul 21 04:05:04 2022] GET /identity/v3/role_assignments?user.id=a93de3ff16dc411cb74a6e6aa14b45ba&scope.system=all&role.id=3e5863fab95146c0a8f915731b4174e3 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:04.339384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1a998-f915-413f-a140-068c15a91e03 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:04.387349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:04.388217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:04.388505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:04.388784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:04.401588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:04.409675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:04.410663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:04.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 162/313] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:04.418532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:04.422233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:04.533139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7a4c-655e-46fe-b895-454cd173d917 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:04.568448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:04.569154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:04.569440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:04.569724 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:04.570479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:04.570790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:04.572177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:04.581283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 152/314] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:04.587223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:04.689194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:04.693682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1342-8cd3-4cb9-a165-4f24bcffef4b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:04.728276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:04.729199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:04.729488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:04.729770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] PATH_INFO: `/v3/users/5b28442b83b1472aa788bef7f8c68f23` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:04.730973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] RBAC: Authorizing `identity:get_user(user_id=5b28442b83b1472aa788bef7f8c68f23)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:04.732495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:04.734513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 163/315] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:04 2022] GET /identity/v3/users/5b28442b83b1472aa788bef7f8c68f23 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:04.740427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:04.808876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:04.850125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f31e6-941a-4b52-8278-29e2b1759b68 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:04.890061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:04.891079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:04.891557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:04.892024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:04.963779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:04.965597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:05.033149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:05.075658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 153/316] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:05.080898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:05.183650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20b2c5-5e07-452a-a93b-f88ba48ef904 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:05.218142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759de4b-2a4b-4728-bd20-bb1747a37d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:05.219004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759de4b-2a4b-4728-bd20-bb1747a37d6c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.219289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759de4b-2a4b-4728-bd20-bb1747a37d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.219568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759de4b-2a4b-4728-bd20-bb1747a37d6c None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.220754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759de4b-2a4b-4728-bd20-bb1747a37d6c None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:05.222235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759de4b-2a4b-4728-bd20-bb1747a37d6c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:05.224220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 164/317] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:05 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:05.230036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:05.333009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a77f8-fd35-49a9-91c2-d9b86226f5b3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:05.369364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f57d7d-4cd0-42ca-b25d-e27820fd8292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:05.370026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57d7d-4cd0-42ca-b25d-e27820fd8292 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.370312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57d7d-4cd0-42ca-b25d-e27820fd8292 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.370594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f57d7d-4cd0-42ca-b25d-e27820fd8292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.371428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f57d7d-4cd0-42ca-b25d-e27820fd8292 None admin] RBAC: Adding query filter params (role.id=3e5863fab95146c0a8f915731b4174e3, scope.project.id=5987f6dac2ef4657891f4fdf482bda82, user.id=5b28442b83b1472aa788bef7f8c68f23) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:05.371740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f57d7d-4cd0-42ca-b25d-e27820fd8292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:05.373208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f57d7d-4cd0-42ca-b25d-e27820fd8292 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:05.379321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 154/318] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:05 2022] GET /identity/v3/role_assignments?user.id=5b28442b83b1472aa788bef7f8c68f23&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=3e5863fab95146c0a8f915731b4174e3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:05.938578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419dc57-c8c9-460f-9240-d2fc8117d011 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.938912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419dc57-c8c9-460f-9240-d2fc8117d011 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.939088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419dc57-c8c9-460f-9240-d2fc8117d011 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.940592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 165/319] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:05.946418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddfe2e-77a1-4f7f-a777-6d6f43cc3c57 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.946718 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddfe2e-77a1-4f7f-a777-6d6f43cc3c57 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.947007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddfe2e-77a1-4f7f-a777-6d6f43cc3c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.964184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-65ddfe2e-77a1-4f7f-a777-6d6f43cc3c57 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:05.965410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-65ddfe2e-77a1-4f7f-a777-6d6f43cc3c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:05.989393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.040870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 155/320] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:06.062738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419dc57-c8c9-460f-9240-d2fc8117d011 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.095996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.170864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419dc57-c8c9-460f-9240-d2fc8117d011 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.204882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e0e4-f604-4ca8-84f7-1bf735835f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.205617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e0e4-f604-4ca8-84f7-1bf735835f0c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.205902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e0e4-f604-4ca8-84f7-1bf735835f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.206188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e0e4-f604-4ca8-84f7-1bf735835f0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.216616 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345e0e4-f604-4ca8-84f7-1bf735835f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f345e0e4-f604-4ca8-84f7-1bf735835f0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:06.224631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:06.225554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:06.226354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:06.228966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 166/321] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:06.231727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddfe2e-77a1-4f7f-a777-6d6f43cc3c57 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.333578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddfe2e-77a1-4f7f-a777-6d6f43cc3c57 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.369419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.370088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.370377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.370658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.371406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:06.371717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.373137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.381621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 156/322] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:06.384679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c7bf-8b2f-47ee-a39b-6941701a79e3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.385085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c7bf-8b2f-47ee-a39b-6941701a79e3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.385374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c7bf-8b2f-47ee-a39b-6941701a79e3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.386978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 167/323] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:06.387212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.391847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d4139-294d-45f6-8ebd-3ce8c44cd955 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.392144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d4139-294d-45f6-8ebd-3ce8c44cd955 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.392431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d4139-294d-45f6-8ebd-3ce8c44cd955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.409384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-813d4139-294d-45f6-8ebd-3ce8c44cd955 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:06.410150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.410597 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-813d4139-294d-45f6-8ebd-3ce8c44cd955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:06.483119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 168/324] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:06.484349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51273-39ff-4094-af5f-749687c92fec None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.484641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51273-39ff-4094-af5f-749687c92fec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.484955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51273-39ff-4094-af5f-749687c92fec None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.486345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 169/325] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:06.494233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dc25e-714c-41cf-9605-f937bafea8db None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.494519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dc25e-714c-41cf-9605-f937bafea8db None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.494801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dc25e-714c-41cf-9605-f937bafea8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.497358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a57a7-ad80-483a-b48f-a1c14d172599 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.510682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2b5dc25e-714c-41cf-9605-f937bafea8db None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:06.511860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2b5dc25e-714c-41cf-9605-f937bafea8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:06.528509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.532579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.533492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.533780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.534062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] PATH_INFO: `/v3/users/d804257d3b344b8cb4a475cc2ad60689` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.535259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] RBAC: Authorizing `identity:get_user(user_id=d804257d3b344b8cb4a475cc2ad60689)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.536715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.539017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 157/326] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/users/d804257d3b344b8cb4a475cc2ad60689 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:06.541733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.579437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 170/327] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:06.580275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dc25e-714c-41cf-9605-f937bafea8db None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.633570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.647061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39c43-a2e4-46e9-a696-b9dce89ced0a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.680972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.681764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.682047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.682323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.683474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.684968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dc25e-714c-41cf-9605-f937bafea8db None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.685071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.686569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 158/328] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:06.688957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.723728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.724696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.725019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.725309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.726147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] RBAC: Adding query filter params (role.id=d428254d31484e108ec67491b911bc1f, user.id=d804257d3b344b8cb4a475cc2ad60689, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:06.726468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.727930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.739474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 171/329] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/role_assignments?user.id=d804257d3b344b8cb4a475cc2ad60689&scope.system=all&role.id=d428254d31484e108ec67491b911bc1f => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:06.740674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.754066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.804243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ae307-d9bc-4362-b325-859ae3379af2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.842109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.842999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.843296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.843825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.853284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c958-40ac-4d50-83a9-4ac981008710 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.855499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:06.863628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:06.864770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:06.866612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 159/330] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:06.871816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.894806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.900329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.901333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.902310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.902310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] PATH_INFO: `/v3/groups` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.902772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.904590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.921511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 172/331] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:06.997390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc65c09-7e9b-42f0-b771-d22b225e009a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.033348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.034035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.034325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.034610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.035384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:07.035700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.037740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.046942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 160/332] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:07.052796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:07.126627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.164751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30ca5-3997-4dd6-b523-b93180479606 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.201592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2f231-16b7-4715-895b-38b94cb0fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.202509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f231-16b7-4715-895b-38b94cb0fbbb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.202800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f231-16b7-4715-895b-38b94cb0fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.203073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f231-16b7-4715-895b-38b94cb0fbbb None admin] PATH_INFO: `/v3/users/a93de3ff16dc411cb74a6e6aa14b45ba` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.204289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2f231-16b7-4715-895b-38b94cb0fbbb None admin] RBAC: Authorizing `identity:get_user(user_id=a93de3ff16dc411cb74a6e6aa14b45ba)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.205791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2f231-16b7-4715-895b-38b94cb0fbbb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.207438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 173/333] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:07 2022] GET /identity/v3/users/a93de3ff16dc411cb74a6e6aa14b45ba => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:07.214003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:07.298581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.327105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92520517-6fd2-4804-ab22-61a868a7e97f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.366452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaa509-adc1-4d32-8406-26d922010351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.367367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa509-adc1-4d32-8406-26d922010351 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.367925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa509-adc1-4d32-8406-26d922010351 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.368211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa509-adc1-4d32-8406-26d922010351 None admin] PATH_INFO: `/v3/system/users/a93de3ff16dc411cb74a6e6aa14b45ba/roles/3e5863fab95146c0a8f915731b4174e3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.369772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaa509-adc1-4d32-8406-26d922010351 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a93de3ff16dc411cb74a6e6aa14b45ba, role_id=3e5863fab95146c0a8f915731b4174e3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.371178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaa509-adc1-4d32-8406-26d922010351 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.382635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 161/334] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Jul 21 04:05:07 2022] PUT /identity/v3/system/users/a93de3ff16dc411cb74a6e6aa14b45ba/roles/3e5863fab95146c0a8f915731b4174e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:05:09.347711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b679-ff1b-4289-9518-ee774546083d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.348276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b679-ff1b-4289-9518-ee774546083d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.348359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b679-ff1b-4289-9518-ee774546083d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.350980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 174/335] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:09.356061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c001a-84b1-4f7d-a633-1bc9a16591e5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.356471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c001a-84b1-4f7d-a633-1bc9a16591e5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.356544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c001a-84b1-4f7d-a633-1bc9a16591e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.377811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-be6c001a-84b1-4f7d-a633-1bc9a16591e5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:09.379022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-be6c001a-84b1-4f7d-a633-1bc9a16591e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:09.467668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 162/336] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:09.494351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2b679-ff1b-4289-9518-ee774546083d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.622088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2b679-ff1b-4289-9518-ee774546083d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:09.664722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69af7f8-986a-4197-9ec5-e21a066b1801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:09.668103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69af7f8-986a-4197-9ec5-e21a066b1801 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.668103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69af7f8-986a-4197-9ec5-e21a066b1801 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.668103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69af7f8-986a-4197-9ec5-e21a066b1801 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.679196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:09.689749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69af7f8-986a-4197-9ec5-e21a066b1801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d69af7f8-986a-4197-9ec5-e21a066b1801 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:09.697900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:09.698819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:09.699631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 175/337] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:09.705306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c001a-84b1-4f7d-a633-1bc9a16591e5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.800578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:09.840614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c001a-84b1-4f7d-a633-1bc9a16591e5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:09.842824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c7a2-2c9c-4ec0-aebd-454150163068 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.843111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c7a2-2c9c-4ec0-aebd-454150163068 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.843396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8c7a2-2c9c-4ec0-aebd-454150163068 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.845052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 176/338] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:09.851066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dceed7-54b7-4910-92ac-c29e85eff7e7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.851351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dceed7-54b7-4910-92ac-c29e85eff7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.851629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dceed7-54b7-4910-92ac-c29e85eff7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.885031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:09.885640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.885929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.886211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.886976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:09.887291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:09.888684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:09.898185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-91dceed7-54b7-4910-92ac-c29e85eff7e7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:09.899394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91dceed7-54b7-4910-92ac-c29e85eff7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:09.905358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 163/339] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:09.922141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.003475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 177/340] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:10.045080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dceed7-54b7-4910-92ac-c29e85eff7e7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.076342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da4d0-3bfd-4051-98ce-c8f58095069d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.137628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ed85-c64d-4297-b1e6-b65a9d65b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.138221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ed85-c64d-4297-b1e6-b65a9d65b171 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.138511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ed85-c64d-4297-b1e6-b65a9d65b171 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.138797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ed85-c64d-4297-b1e6-b65a9d65b171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.147895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.195641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dceed7-54b7-4910-92ac-c29e85eff7e7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.249180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.262926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed1f8-5568-4db0-81b9-1178d1d9f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.263730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed1f8-5568-4db0-81b9-1178d1d9f712 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.264017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed1f8-5568-4db0-81b9-1178d1d9f712 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.264295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed1f8-5568-4db0-81b9-1178d1d9f712 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.280983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ed85-c64d-4297-b1e6-b65a9d65b171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.282462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ed85-c64d-4297-b1e6-b65a9d65b171 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.296361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed1f8-5568-4db0-81b9-1178d1d9f712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-093ed1f8-5568-4db0-81b9-1178d1d9f712 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:10.306713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:10.307624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:10.308447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 178/341] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:10.309696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354eed-a1bb-4b5d-95dc-52bae1c24fd9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.309877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354eed-a1bb-4b5d-95dc-52bae1c24fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.310149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354eed-a1bb-4b5d-95dc-52bae1c24fd9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.321085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 179/342] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:10.322193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79354eed-a1bb-4b5d-95dc-52bae1c24fd9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.488199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 164/343] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:05:10.489412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c50bc4-e561-4e43-8b6d-f55cabd2fb4a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.489715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c50bc4-e561-4e43-8b6d-f55cabd2fb4a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.490582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c50bc4-e561-4e43-8b6d-f55cabd2fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.502843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79354eed-a1bb-4b5d-95dc-52bae1c24fd9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.517562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-25c50bc4-e561-4e43-8b6d-f55cabd2fb4a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:10.518776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-25c50bc4-e561-4e43-8b6d-f55cabd2fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:10.564355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.565793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.566753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.567381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.568624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.570823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:10.571351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.573017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.583376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 180/344] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:10.585306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.623248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 165/345] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:10.624410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d882b5-6f50-474d-898b-6d2ccb22f0c0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.624708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d882b5-6f50-474d-898b-6d2ccb22f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.633215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d882b5-6f50-474d-898b-6d2ccb22f0c0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.634827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 166/346] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:10.635777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d882b5-6f50-474d-898b-6d2ccb22f0c0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.658730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.719486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27fc9-3443-48a7-bf53-0fcad5847c43 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.763902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99179-95e7-40f7-baf5-b88e9352ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.765186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99179-95e7-40f7-baf5-b88e9352ce6a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.765802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99179-95e7-40f7-baf5-b88e9352ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.766160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99179-95e7-40f7-baf5-b88e9352ce6a None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.767524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab99179-95e7-40f7-baf5-b88e9352ce6a None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.769219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab99179-95e7-40f7-baf5-b88e9352ce6a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.771418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 181/347] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:10.773003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68c90-25b0-4d9f-999d-f9b3cf5cb040 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.773371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68c90-25b0-4d9f-999d-f9b3cf5cb040 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.773730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68c90-25b0-4d9f-999d-f9b3cf5cb040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.783924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d882b5-6f50-474d-898b-6d2ccb22f0c0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.800137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a3f68c90-25b0-4d9f-999d-f9b3cf5cb040 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:10.801464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3f68c90-25b0-4d9f-999d-f9b3cf5cb040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:10.832698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.834141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.835259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.835750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.875719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.890415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 182/348] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:10.891591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68c90-25b0-4d9f-999d-f9b3cf5cb040 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.940282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.941859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.947304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.004324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68c90-25b0-4d9f-999d-f9b3cf5cb040 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.045554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.047372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.047992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.049218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.064227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:11.072957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 167/349] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:11.074102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:11.074566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:11.075463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:11.076277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 183/350] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:11.077000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.156467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.203525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab5fbb-b88e-4c76-a2e9-9ba78728c669 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.214892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b64bc3-b316-4a11-8eff-6c2f9ed735d7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.215520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.244047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.244901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.245193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.245475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.256660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:11.260719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.261622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.261908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.262187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:11.265004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:11.265866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 184/351] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:11.267076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.270926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.273461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.275467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 168/352] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.276273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.385105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70dd5e-7e31-4359-89f4-bb56cf0ddab0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.393440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121706e-e7c0-4951-a189-bc683e88ff8b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.422089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.426702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33c6a2-8a78-40a2-a88f-7a2ec1e0605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.427836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c6a2-8a78-40a2-a88f-7a2ec1e0605d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.428342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c6a2-8a78-40a2-a88f-7a2ec1e0605d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.428730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c6a2-8a78-40a2-a88f-7a2ec1e0605d None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.430006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33c6a2-8a78-40a2-a88f-7a2ec1e0605d None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.431761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33c6a2-8a78-40a2-a88f-7a2ec1e0605d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.432633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.433414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 185/353] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.433521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.433593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.433881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.434401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ed81c-e694-4652-9bde-4f832c74ed17 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.434645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:11.434743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ed81c-e694-4652-9bde-4f832c74ed17 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.434947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ed81c-e694-4652-9bde-4f832c74ed17 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.435040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.436432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.438836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 186/354] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:11.438836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a370f6-730d-4239-bdab-e98f4004b295 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.438836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a370f6-730d-4239-bdab-e98f4004b295 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.439204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a370f6-730d-4239-bdab-e98f4004b295 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.440910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 187/355] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:11.441646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a370f6-730d-4239-bdab-e98f4004b295 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.449800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 169/356] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.451476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.484100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.567705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917441-ad96-447a-9490-87f753e0c9a1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.568364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a370f6-730d-4239-bdab-e98f4004b295 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.611720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.612392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.612675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.612991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.615588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=ab2ef030d9f2488986abf43273a1dee2) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:11.615588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.615779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb39184-d50b-4f2f-8a29-a8580497f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.615779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39184-d50b-4f2f-8a29-a8580497f01d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.615996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.616145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39184-d50b-4f2f-8a29-a8580497f01d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.616534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39184-d50b-4f2f-8a29-a8580497f01d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.617412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb39184-d50b-4f2f-8a29-a8580497f01d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:11.617996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb39184-d50b-4f2f-8a29-a8580497f01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.619875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb39184-d50b-4f2f-8a29-a8580497f01d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.622482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 170/357] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=d428254d31484e108ec67491b911bc1f => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.623303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.628515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 188/358] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.630052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ba34-a1ed-4676-8462-a4601f048db9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.630345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ba34-a1ed-4676-8462-a4601f048db9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.631178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ba34-a1ed-4676-8462-a4601f048db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.654863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6680ba34-a1ed-4676-8462-a4601f048db9 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:11.656174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6680ba34-a1ed-4676-8462-a4601f048db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:11.715726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.757134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 189/359] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:11.758995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83536b5-a953-4459-aa5a-30ae39e21990 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.759515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83536b5-a953-4459-aa5a-30ae39e21990 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.759991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83536b5-a953-4459-aa5a-30ae39e21990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.781894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c83536b5-a953-4459-aa5a-30ae39e21990 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:11.783596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c83536b5-a953-4459-aa5a-30ae39e21990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:11.791280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c694f31-942b-46a1-b658-69f6599ff6cd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.819347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.836657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.837976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.838445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.838957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.840402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.842600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.844899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 171/360] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.846259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.880953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 190/361] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:11.881832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83536b5-a953-4459-aa5a-30ae39e21990 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.991233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21175aa-b350-4181-ab80-2463411e2770 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.010636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83536b5-a953-4459-aa5a-30ae39e21990 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.018414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.040320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.040320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.040320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.040320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] PATH_INFO: `/v3/users/a93de3ff16dc411cb74a6e6aa14b45ba` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.041692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=a93de3ff16dc411cb74a6e6aa14b45ba)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.043623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.045595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 172/362] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/users/a93de3ff16dc411cb74a6e6aa14b45ba => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.049350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.059725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.060390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.060673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.060985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.094087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.144338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.145915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.184761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c93db-c651-4ce5-8765-dbe0822da5e3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.232768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.233614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.233890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.234170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.247416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:12.256251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:12.257223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:12.258032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:12.258650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 173/363] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:12.259629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.285413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 191/364] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:12.286019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.319333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.357385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.389540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7e176-f01c-4f5f-9850-287af24bceb8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.416412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1921c-9f5d-4a74-9440-324fa71450fe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.436224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.437116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.437393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.438628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.438628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=5987f6dac2ef4657891f4fdf482bda82) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.439613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.441145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.447603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 174/365] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=d428254d31484e108ec67491b911bc1f => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.448235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.467553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.469677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.470207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.470693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.487831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:12.499175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:12.500104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:12.500950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:12.502529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 192/366] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:12.503420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.592290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3a61-34a4-4951-a486-cba806e20d95 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.614433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.638958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51cee3-7396-4102-829a-4da7a0fa6385 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.646156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.646824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.647113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.647395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.648706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] RBAC: Adding query filter params (role.id=3e5863fab95146c0a8f915731b4174e3, user.id=a93de3ff16dc411cb74a6e6aa14b45ba, scope.system=all) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.649057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.650508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.667206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 175/367] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/role_assignments?user.id=a93de3ff16dc411cb74a6e6aa14b45ba&scope.system=all&role.id=3e5863fab95146c0a8f915731b4174e3 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.667752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.671423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.697361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.698064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.698421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.698764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.699598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.699919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.701401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.712360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 193/368] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.717996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.896696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6934886-1597-45f1-9b4f-183e45728aaf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.906639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847697-84f6-44ee-8e70-4ab28905ebe5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.940802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.941509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.941799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.942083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.942837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.946017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.946017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.952008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.953200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.953688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.954162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.959168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 194/369] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.959168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.960746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.962463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.965420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 176/370] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.966385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.024356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.030659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.097216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994fb2-adae-46de-9dae-e93da95ec2be None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.097816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cbd3b-8a40-4963-b669-fcabd96120b5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.146621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.147149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.147358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.147601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.147886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.148598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.149640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.150132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.239569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.240664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.241722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.242172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.293191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.297666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.369937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 177/371] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:13.373407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 195/372] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:13.374635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.377187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.484815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1e7c5-3a76-4584-9b7a-0e8c725cf18d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.500515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dde65-1215-484a-9a1c-172f43fc9000 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.522094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.523488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.523870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.524042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.526234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.527698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.530558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 178/373] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.531564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.544733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.550723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.551665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.551952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.552309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] PATH_INFO: `/v3/projects/7d6dae06458e40f5a42cb100a613e196` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.553674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7d6dae06458e40f5a42cb100a613e196)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.555240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.557452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 196/374] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/projects/7d6dae06458e40f5a42cb100a613e196 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.558383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.577495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.667503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e560-7080-4622-a09f-13b432103d85 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.699510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd0f9-ea77-47f2-bea2-b275b64313e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.714106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.714982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.715265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.715542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.716923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.718347 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.720382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 179/375] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.721181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.755439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.756745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.757504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.758405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.759717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=1be9be19909c40699636c4973a021627, scope.project.id=ab2ef030d9f2488986abf43273a1dee2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:13.760232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.762805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.771612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 197/376] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=1be9be19909c40699636c4973a021627 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.773598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.838520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.885389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b2eb-98b3-4158-a058-b429d6ad0ca8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.887918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.924588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c29b20-36c1-4cf1-b246-dd0c145d7150 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.936907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb746d9-4846-4238-a86b-878e63bf6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.937876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb746d9-4846-4238-a86b-878e63bf6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.938168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb746d9-4846-4238-a86b-878e63bf6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.938451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb746d9-4846-4238-a86b-878e63bf6bd4 None admin] PATH_INFO: `/v3/groups/21521c2b786e4411b92200159174b850` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.945936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb746d9-4846-4238-a86b-878e63bf6bd4 None admin] RBAC: Authorizing `identity:get_group(group_id=21521c2b786e4411b92200159174b850)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.947382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb746d9-4846-4238-a86b-878e63bf6bd4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.950007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 180/377] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/groups/21521c2b786e4411b92200159174b850 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.951184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9531e-0b04-4c51-b289-4bc0a0c63e3c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.951477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9531e-0b04-4c51-b289-4bc0a0c63e3c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.951763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9531e-0b04-4c51-b289-4bc0a0c63e3c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.953121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 181/378] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:13.957942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9531e-0b04-4c51-b289-4bc0a0c63e3c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.972519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f5e7b-356e-4988-b64a-1f920fbabd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.973729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f5e7b-356e-4988-b64a-1f920fbabd02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.974328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f5e7b-356e-4988-b64a-1f920fbabd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.974668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f5e7b-356e-4988-b64a-1f920fbabd02 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.975997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f5e7b-356e-4988-b64a-1f920fbabd02 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.977552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f5e7b-356e-4988-b64a-1f920fbabd02 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.979390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 198/379] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.980437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa3df-a0e4-4013-acec-85763fef26ab None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.980729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa3df-a0e4-4013-acec-85763fef26ab None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.985210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa3df-a0e4-4013-acec-85763fef26ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.008404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7a4fa3df-a0e4-4013-acec-85763fef26ab None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:14.012924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7a4fa3df-a0e4-4013-acec-85763fef26ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:14.096777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 199/380] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:14.097983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa3df-a0e4-4013-acec-85763fef26ab None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.114428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9531e-0b04-4c51-b289-4bc0a0c63e3c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.171094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.171321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.171562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.171750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.172748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] RBAC: Adding query filter params (group.id=21521c2b786e4411b92200159174b850, role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=7d6dae06458e40f5a42cb100a613e196) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.173102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.175217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.181684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 182/381] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/role_assignments?group.id=21521c2b786e4411b92200159174b850&scope.project.id=7d6dae06458e40f5a42cb100a613e196&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.183130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.189285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.190391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.228788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa3df-a0e4-4013-acec-85763fef26ab None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.294208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.294808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.295095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.295371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.297199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=1be9be19909c40699636c4973a021627, scope.project.id=5987f6dac2ef4657891f4fdf482bda82) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.297522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.299009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.317585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 200/382] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=1be9be19909c40699636c4973a021627 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.345426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82b1f-3151-4197-952d-36f7122774bc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.396256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.397458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.397947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.398426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.415101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:14.423614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:14.424640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:14.425557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:14.428579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 183/383] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:14.434660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.570320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea12c2-b7f6-4ab0-8129-db31a5f9a30f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.619797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.620534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.620841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.621176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.621927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.622237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.623615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.627673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.636736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 201/384] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.640032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.731173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.770993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af70be-029d-4aa1-80d9-13a3092fb3ec None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.806712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573e69-3829-48da-9e49-1b50c503aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.807583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573e69-3829-48da-9e49-1b50c503aebb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.807862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573e69-3829-48da-9e49-1b50c503aebb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.808137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573e69-3829-48da-9e49-1b50c503aebb None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.809355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad573e69-3829-48da-9e49-1b50c503aebb None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.810815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad573e69-3829-48da-9e49-1b50c503aebb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.812732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 184/385] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.818478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.980408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76e55-c626-46e4-9627-37d6545fc769 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.024294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429fb13-0157-419e-a089-cd88bae55f0a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.024632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429fb13-0157-419e-a089-cd88bae55f0a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.024881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429fb13-0157-419e-a089-cd88bae55f0a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.026515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 185/386] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:15.031674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a1bf-770b-4865-a0c4-2bad548a70a0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.031961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a1bf-770b-4865-a0c4-2bad548a70a0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.032249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a1bf-770b-4865-a0c4-2bad548a70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.037783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.038987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.039498 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.040001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.041487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:15.043157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:15.045642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 202/387] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:15.049016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b527a1bf-770b-4865-a0c4-2bad548a70a0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:15.050500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b527a1bf-770b-4865-a0c4-2bad548a70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:15.050937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.125770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.185710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7407a3-7b9b-4195-af9b-28bd8b6a8a08 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.193767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 186/388] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:15.223930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a1bf-770b-4865-a0c4-2bad548a70a0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.246060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.248696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.250664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.251171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2/groups/93c0841831f542469cd598791a095a6e/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.255772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2ef030d9f2488986abf43273a1dee2, group_id=93c0841831f542469cd598791a095a6e, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:15.259686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:15.282409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 203/389] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jul 21 04:05:15 2022] PUT /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2/groups/93c0841831f542469cd598791a095a6e/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:05:15.320360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.365752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a1bf-770b-4865-a0c4-2bad548a70a0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.412874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.414153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.414648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.415141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.435211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:15.444045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:15.445023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:15.445912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:15.448846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 187/390] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:15.454225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.565560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ffad5-ee91-4bea-b344-d6d1ded785ef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.591782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.602853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.603578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.603869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.604149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.604958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:15.605622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:15.607339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:15.621129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 204/391] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:15.623117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.766807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce88907-6745-467f-8ba8-58084774d860 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.793215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.803725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.804602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.804923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.805211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.806421 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:15.807889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:15.809944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 188/392] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:15.815269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.961405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46e0c-59eb-4647-9dd9-9e527cc54f2e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.999526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb973ab9-d296-4fd2-aed0-6bffad473f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.000703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973ab9-d296-4fd2-aed0-6bffad473f4a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.001210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973ab9-d296-4fd2-aed0-6bffad473f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.001668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb973ab9-d296-4fd2-aed0-6bffad473f4a None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.003046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb973ab9-d296-4fd2-aed0-6bffad473f4a None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.004693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb973ab9-d296-4fd2-aed0-6bffad473f4a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.007583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 205/393] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:16.013568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.181460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b175-e453-4db6-8d0f-a3c5221190f4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.230053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692ccc7-90e4-44c6-b8f3-3072ca7169da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.230870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ccc7-90e4-44c6-b8f3-3072ca7169da None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.231161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ccc7-90e4-44c6-b8f3-3072ca7169da None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.231446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ccc7-90e4-44c6-b8f3-3072ca7169da None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82/groups/93c0841831f542469cd598791a095a6e/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.238174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692ccc7-90e4-44c6-b8f3-3072ca7169da None admin] RBAC: Authorizing `identity:create_grant(project_id=5987f6dac2ef4657891f4fdf482bda82, group_id=93c0841831f542469cd598791a095a6e, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.239682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692ccc7-90e4-44c6-b8f3-3072ca7169da None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.259614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 189/394] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jul 21 04:05:16 2022] PUT /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82/groups/93c0841831f542469cd598791a095a6e/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:16.332780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c385-f4c1-46ec-854a-aad593657d17 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.332780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c385-f4c1-46ec-854a-aad593657d17 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.332780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c385-f4c1-46ec-854a-aad593657d17 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.333644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 206/395] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:16.339960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf1bc6-580e-42a6-bd03-1683e665310f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.340518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf1bc6-580e-42a6-bd03-1683e665310f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.341027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf1bc6-580e-42a6-bd03-1683e665310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.360688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9caf1bc6-580e-42a6-bd03-1683e665310f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:16.362363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9caf1bc6-580e-42a6-bd03-1683e665310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:16.420151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:16.450297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 190/396] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:16.479769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4c385-f4c1-46ec-854a-aad593657d17 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.542544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:16.591011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4c385-f4c1-46ec-854a-aad593657d17 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.637684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.638512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.638804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.639086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.659956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:16.673376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:16.674278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:16.675190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 207/397] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:16.681064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf1bc6-580e-42a6-bd03-1683e665310f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.815040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf1bc6-580e-42a6-bd03-1683e665310f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.864000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3190a-4ca1-4042-b17b-c5ccfb9bb091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.864713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3190a-4ca1-4042-b17b-c5ccfb9bb091 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.865047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3190a-4ca1-4042-b17b-c5ccfb9bb091 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.865379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3190a-4ca1-4042-b17b-c5ccfb9bb091 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.866076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3190a-4ca1-4042-b17b-c5ccfb9bb091 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:16.866389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3190a-4ca1-4042-b17b-c5ccfb9bb091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.868049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3190a-4ca1-4042-b17b-c5ccfb9bb091 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.878993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 191/398] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:16.885208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.890180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2418-8059-4812-83c0-1eb770171342 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.890469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2418-8059-4812-83c0-1eb770171342 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.890758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2418-8059-4812-83c0-1eb770171342 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.892244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 192/399] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:16.901754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f9ba8-9776-4fef-97c6-795a6519b59e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.902049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f9ba8-9776-4fef-97c6-795a6519b59e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.902336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f9ba8-9776-4fef-97c6-795a6519b59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.932117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fb5f9ba8-9776-4fef-97c6-795a6519b59e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:16.934510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb5f9ba8-9776-4fef-97c6-795a6519b59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:17.005192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.049806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ddf9a-bc82-4ffe-a3d0-049b27023c88 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.064851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 193/400] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 04:05:17.075511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.102781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.104052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.104568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.105089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.106599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.108370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.110595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 208/401] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.115892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.116105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f9ba8-9776-4fef-97c6-795a6519b59e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.227466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f9ba8-9776-4fef-97c6-795a6519b59e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.247818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4853f7-2fac-4d44-bb3c-7be0d4087d1b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.263731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa5471-1a0b-40bd-b93a-4f9662163a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.264566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa5471-1a0b-40bd-b93a-4f9662163a68 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.265017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa5471-1a0b-40bd-b93a-4f9662163a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.265308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa5471-1a0b-40bd-b93a-4f9662163a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.277340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa5471-1a0b-40bd-b93a-4f9662163a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:17.283164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.284025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.284306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.284580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-67aa5471-1a0b-40bd-b93a-4f9662163a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:17.285741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:17.287207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:17.288004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:17.288622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.288701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 194/402] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:17.288775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.289384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e398-a1b6-4f4b-b4e2-88e20cdca7e2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.289544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e398-a1b6-4f4b-b4e2-88e20cdca7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.292465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e398-a1b6-4f4b-b4e2-88e20cdca7e2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.292607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 209/403] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.292700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 195/404] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:17.296171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.297689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e398-a1b6-4f4b-b4e2-88e20cdca7e2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.347239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.357725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.411437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c7e5a-f913-4c1e-a03d-9d8984872239 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.443417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e398-a1b6-4f4b-b4e2-88e20cdca7e2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.449154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f0264-ee90-44fe-962e-d9de92df232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.450289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f0264-ee90-44fe-962e-d9de92df232e None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.450798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f0264-ee90-44fe-962e-d9de92df232e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.451276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f0264-ee90-44fe-962e-d9de92df232e None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2/groups/93c0841831f542469cd598791a095a6e/roles/1be9be19909c40699636c4973a021627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.453750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f0264-ee90-44fe-962e-d9de92df232e None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2ef030d9f2488986abf43273a1dee2, group_id=93c0841831f542469cd598791a095a6e, role_id=1be9be19909c40699636c4973a021627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.455522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f0264-ee90-44fe-962e-d9de92df232e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.472923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 210/405] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jul 21 04:05:17 2022] PUT /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2/groups/93c0841831f542469cd598791a095a6e/roles/1be9be19909c40699636c4973a021627 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:17.475456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635e93-1c9a-4b03-8151-d0480deec265 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.476222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635e93-1c9a-4b03-8151-d0480deec265 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.476713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635e93-1c9a-4b03-8151-d0480deec265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.482135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.482832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.483353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.483570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.484397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:17.484710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.486285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.496791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 196/406] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.498957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-27635e93-1c9a-4b03-8151-d0480deec265 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:17.500571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27635e93-1c9a-4b03-8151-d0480deec265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:17.502523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.577781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 211/407] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:17.619135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27635e93-1c9a-4b03-8151-d0480deec265 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.641563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.657685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346aeff-5dc0-4d2e-8956-500b0ab09fd5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.711613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.729576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.730979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.731272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.731555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] PATH_INFO: `/v3/groups/21521c2b786e4411b92200159174b850` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.733096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] RBAC: Authorizing `identity:get_group(group_id=21521c2b786e4411b92200159174b850)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.735319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.737878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 197/408] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/groups/21521c2b786e4411b92200159174b850 => generated 229 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.746575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.802888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27635e93-1c9a-4b03-8151-d0480deec265 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.872356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab37040-b3fa-438b-878c-273eb26b5db7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.882186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf4397-acd4-4bb6-8f21-447dc3e74872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.883261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4397-acd4-4bb6-8f21-447dc3e74872 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.883721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4397-acd4-4bb6-8f21-447dc3e74872 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.884170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4397-acd4-4bb6-8f21-447dc3e74872 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.901909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf4397-acd4-4bb6-8f21-447dc3e74872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7ebf4397-acd4-4bb6-8f21-447dc3e74872 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:17.911064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:17.912203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:17.913055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:17.915246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 212/409] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:17.919899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a9ac1-dd06-48a7-9c00-ae782a366578 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.919899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a9ac1-dd06-48a7-9c00-ae782a366578 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.919899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a9ac1-dd06-48a7-9c00-ae782a366578 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.922403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 213/410] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:17.923175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a9ac1-dd06-48a7-9c00-ae782a366578 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.942670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed69786-e6d3-4950-b788-e5e1d9debb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.944772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed69786-e6d3-4950-b788-e5e1d9debb6f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.945265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed69786-e6d3-4950-b788-e5e1d9debb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.945715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed69786-e6d3-4950-b788-e5e1d9debb6f None admin] PATH_INFO: `/v3/projects/7d6dae06458e40f5a42cb100a613e196` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.947625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed69786-e6d3-4950-b788-e5e1d9debb6f None admin] RBAC: Authorizing `identity:get_project(project_id=7d6dae06458e40f5a42cb100a613e196)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.949846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed69786-e6d3-4950-b788-e5e1d9debb6f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.952990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 198/411] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/projects/7d6dae06458e40f5a42cb100a613e196 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.960216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf89b-c1cc-4f25-a256-0475e1864db5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.960736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf89b-c1cc-4f25-a256-0475e1864db5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.961212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf89b-c1cc-4f25-a256-0475e1864db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.982353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a41bf89b-c1cc-4f25-a256-0475e1864db5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:17.984410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a41bf89b-c1cc-4f25-a256-0475e1864db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:18.023761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.039970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a9ac1-dd06-48a7-9c00-ae782a366578 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.041759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.063118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 199/412] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:18.063963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf89b-c1cc-4f25-a256-0475e1864db5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.090263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.090994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.091341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.091624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.092434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.092759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.094299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.108906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 214/413] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.108906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.212618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf89b-c1cc-4f25-a256-0475e1864db5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.217796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a58228-588c-43c5-877b-9a6c35c49828 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.249410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.250841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.251319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.251795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] PATH_INFO: `/v3/projects/7d6dae06458e40f5a42cb100a613e196/groups/21521c2b786e4411b92200159174b850/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.253983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d6dae06458e40f5a42cb100a613e196, group_id=21521c2b786e4411b92200159174b850, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.255658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.255765 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.256528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.256839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.257181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.269800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:18.271644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 200/414] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jul 21 04:05:18 2022] PUT /identity/v3/projects/7d6dae06458e40f5a42cb100a613e196/groups/21521c2b786e4411b92200159174b850/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:18.272690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:18.279598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:18.280561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:18.281426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 215/415] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:18.288988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.302006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.326154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.399273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53dda-b583-494e-8435-344b630b23b6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.415646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2fc18-ba1c-4112-a406-698170e821f9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.438440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.439866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.440357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.440887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.442394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.444492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.446509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 201/416] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.454698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.462190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.463258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.463800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.464286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.465340 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.465964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.467821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.479695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 216/417] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.485667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.549022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.561704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec1141-e2b5-4c74-9610-b850a2218310 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.589608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.599800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.600739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.601047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.601326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.602524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.603992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.606060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 202/418] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:18.614348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8911612-7f17-459d-a02e-080743ff1605 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.616615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.653446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e2de3-c251-4c7a-ae4f-1539aa69264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.654462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2de3-c251-4c7a-ae4f-1539aa69264d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.654952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2de3-c251-4c7a-ae4f-1539aa69264d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.655451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2de3-c251-4c7a-ae4f-1539aa69264d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.732578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e2de3-c251-4c7a-ae4f-1539aa69264d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.734564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e2de3-c251-4c7a-ae4f-1539aa69264d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.736161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d817963-2396-4c90-bf6c-b3a422df883c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.773953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.774307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.774498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.774760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82/groups/93c0841831f542469cd598791a095a6e/roles/1be9be19909c40699636c4973a021627` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.777063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] RBAC: Authorizing `identity:create_grant(project_id=5987f6dac2ef4657891f4fdf482bda82, group_id=93c0841831f542469cd598791a095a6e, role_id=1be9be19909c40699636c4973a021627)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.778526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.794485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 203/419] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Jul 21 04:05:18 2022] PUT /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82/groups/93c0841831f542469cd598791a095a6e/roles/1be9be19909c40699636c4973a021627 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:05:18.837798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.856182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 217/420] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:18.862068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.893752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.956879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a089d7-87ec-49e9-a0e5-13ce847b4465 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.957523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a089d7-87ec-49e9-a0e5-13ce847b4465 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.958075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a089d7-87ec-49e9-a0e5-13ce847b4465 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.960463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 218/421] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:18.973189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753ddc-14c6-460a-8362-61a012bd7aa0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.973499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753ddc-14c6-460a-8362-61a012bd7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.973750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753ddc-14c6-460a-8362-61a012bd7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.997967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-be753ddc-14c6-460a-8362-61a012bd7aa0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:18.999931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-be753ddc-14c6-460a-8362-61a012bd7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:19.052869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43ee6-6501-4f12-b759-6c8722186351 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.079506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 219/422] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:19.093932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.094811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.095089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.095364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.096552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.098046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.101332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 204/423] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:19.103657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be753ddc-14c6-460a-8362-61a012bd7aa0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.107628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.201397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.209539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be753ddc-14c6-460a-8362-61a012bd7aa0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.220685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67df3-f7b7-44c9-8a8b-581426846b0c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.227155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.247454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.248305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.248528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.248801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.259950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:19.261636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.262517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.262801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.263075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.264252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.265719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.267643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 205/424] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:19.267934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:19.269613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:19.271697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 220/425] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:19.275004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.279568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.379959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e38a7-d5ed-4164-8afd-d849bd94f727 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.386868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63010-5a3c-4bad-b5e7-aa5e8cc1f492 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.416162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.416847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.417140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.417419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.418167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:19.418475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.419866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.426515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.427453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.428202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.428485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.429308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 221/426] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:19.429488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=ab2ef030d9f2488986abf43273a1dee2) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:19.429640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.431088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.434722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.438047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 206/427] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=d428254d31484e108ec67491b911bc1f => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:19.481238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.577116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b30e91-5709-49ac-973f-2a071e345fdd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.621140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.622180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.622672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.623175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.717527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.719256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.761522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.828509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 222/428] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:05:19.833924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.856741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.968431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd1c2-8e92-4b30-b03a-1d7a7802ee1a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.007914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef7b75-0de4-4823-b2ae-80ff55e7f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.008786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7b75-0de4-4823-b2ae-80ff55e7f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.009098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7b75-0de4-4823-b2ae-80ff55e7f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.009373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7b75-0de4-4823-b2ae-80ff55e7f5b1 None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.010591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef7b75-0de4-4823-b2ae-80ff55e7f5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.012039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef7b75-0de4-4823-b2ae-80ff55e7f5b1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.014090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 207/429] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:20.019591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.132540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7119021-d2c8-494f-9dfc-c012b5061c83 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.165748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1eae-730c-4867-8a48-48c694493104 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.166036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1eae-730c-4867-8a48-48c694493104 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.166321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf1eae-730c-4867-8a48-48c694493104 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.168087 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 208/430] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:20.173007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bab21-5fba-4fd0-abb4-623b1fce33cd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.173306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bab21-5fba-4fd0-abb4-623b1fce33cd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.173597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bab21-5fba-4fd0-abb4-623b1fce33cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.178111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.178985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.179271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.179618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.180909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.182375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.184258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 223/431] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:20.189718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.191331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bb3bab21-5fba-4fd0-abb4-623b1fce33cd None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:20.192694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bb3bab21-5fba-4fd0-abb4-623b1fce33cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:20.201323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.279714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 209/432] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:20.305241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bab21-5fba-4fd0-abb4-623b1fce33cd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.317462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793e07f-b649-4c1e-9aef-a1e144c2cfb3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.324325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.366842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.368146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.368640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.369156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.370201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=d428254d31484e108ec67491b911bc1f, scope.project.id=5987f6dac2ef4657891f4fdf482bda82) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:20.370755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.372398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.379090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 224/433] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=d428254d31484e108ec67491b911bc1f => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:20.433848 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bab21-5fba-4fd0-abb4-623b1fce33cd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.473400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.474876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.475104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.475390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.487662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:20.496907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:20.497861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:20.498689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 210/434] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:20.506631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.588478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.622363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4a22b-4fe7-4fcf-bdaa-4f560f5d179e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.659476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6972499-1ec7-4f14-bbe3-c03c1f18cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.660505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972499-1ec7-4f14-bbe3-c03c1f18cf8e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.661035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972499-1ec7-4f14-bbe3-c03c1f18cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.661652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972499-1ec7-4f14-bbe3-c03c1f18cf8e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.662757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6972499-1ec7-4f14-bbe3-c03c1f18cf8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:20.663071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6972499-1ec7-4f14-bbe3-c03c1f18cf8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.664480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6972499-1ec7-4f14-bbe3-c03c1f18cf8e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.673538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 225/435] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:20.679199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.755106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.781360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b92eed-c4f7-4ee1-af8e-d35aa816a136 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.813909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.814557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.814845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.815121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.883245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.884707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.957575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.984223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 211/436] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:05:20.985908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1b1f-0c86-4a36-b97c-4ed0ccbd82a2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.986215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1b1f-0c86-4a36-b97c-4ed0ccbd82a2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.986502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed1b1f-0c86-4a36-b97c-4ed0ccbd82a2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.987989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 226/437] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:20.989416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.994054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925a2c-1bbd-46f1-bd99-9b08e3928df8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.994352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925a2c-1bbd-46f1-bd99-9b08e3928df8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.994640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925a2c-1bbd-46f1-bd99-9b08e3928df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.011943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-24925a2c-1bbd-46f1-bd99-9b08e3928df8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:21.013186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-24925a2c-1bbd-46f1-bd99-9b08e3928df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:21.084666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 227/438] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:21.097525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db53e8-9d62-4a7c-9840-9e4371e2aef0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.107554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24925a2c-1bbd-46f1-bd99-9b08e3928df8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.135575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.136912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.137208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.137755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] PATH_INFO: `/v3/projects/ab2ef030d9f2488986abf43273a1dee2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.139118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2ef030d9f2488986abf43273a1dee2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.141182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.144972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 212/439] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/projects/ab2ef030d9f2488986abf43273a1dee2 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:21.148553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.179411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.195164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.221415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24925a2c-1bbd-46f1-bd99-9b08e3928df8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.258544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e6845-1602-44fa-88d1-31767b600ee2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.259498 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.260304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.260594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.260911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.272459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:21.280195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:21.281402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:21.285742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 228/440] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:21.287847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.298100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.298966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.299253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.299530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.300712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.302880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.309682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 213/441] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:21.310700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.403069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8eea9d-3844-4925-9684-6ec3a3f524ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.411286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018353-ad8e-4ed6-9997-1eae32ab2278 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.423794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.429169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.442664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794f9c7-297b-4aa1-9ad4-1cafe482fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.443341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f9c7-297b-4aa1-9ad4-1cafe482fef4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.443632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f9c7-297b-4aa1-9ad4-1cafe482fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.443914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794f9c7-297b-4aa1-9ad4-1cafe482fef4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.444672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f9c7-297b-4aa1-9ad4-1cafe482fef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:21.445083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f9c7-297b-4aa1-9ad4-1cafe482fef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.447538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794f9c7-297b-4aa1-9ad4-1cafe482fef4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.449598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add5ec-2401-41e1-9a85-6bab4e49b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.450250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add5ec-2401-41e1-9a85-6bab4e49b315 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.450528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add5ec-2401-41e1-9a85-6bab4e49b315 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.450804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add5ec-2401-41e1-9a85-6bab4e49b315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.451733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92add5ec-2401-41e1-9a85-6bab4e49b315 None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=1be9be19909c40699636c4973a021627, scope.project.id=ab2ef030d9f2488986abf43273a1dee2) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:21.452034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92add5ec-2401-41e1-9a85-6bab4e49b315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.453525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92add5ec-2401-41e1-9a85-6bab4e49b315 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.456343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 229/442] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:21.457661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419726-3ab8-4252-a6df-db5702cceb12 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.457952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419726-3ab8-4252-a6df-db5702cceb12 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.458235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419726-3ab8-4252-a6df-db5702cceb12 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.459688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 230/443] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:21.472088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 214/444] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=ab2ef030d9f2488986abf43273a1dee2&role.id=1be9be19909c40699636c4973a021627 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:21.472311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419726-3ab8-4252-a6df-db5702cceb12 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.472404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cad8a-5c6a-4baf-aa23-02e109458823 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.472404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cad8a-5c6a-4baf-aa23-02e109458823 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.472404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cad8a-5c6a-4baf-aa23-02e109458823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.487068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-663cad8a-5c6a-4baf-aa23-02e109458823 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:21.488814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-663cad8a-5c6a-4baf-aa23-02e109458823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:21.583376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 215/445] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:21.609180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cad8a-5c6a-4baf-aa23-02e109458823 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.622950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419726-3ab8-4252-a6df-db5702cceb12 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.674988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.676694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.676694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.676905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.741434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cad8a-5c6a-4baf-aa23-02e109458823 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.746765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.766935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.787138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.788647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.811362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.812590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.812590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.812864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.826642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:21.838940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:21.839850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:21.845641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 216/446] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:21.848792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.925857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 231/447] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:21.937140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.982411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f661-9613-47d7-9085-a67bcd11918f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.034966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.034966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.034966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.034966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.035788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:22.035788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.036001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.051578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 217/448] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:22.053698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.057779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.077156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc60b2b-8e07-41ae-906e-6a1f0644b10f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.083768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.116455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.117266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.117554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.118091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] PATH_INFO: `/v3/projects/7d6dae06458e40f5a42cb100a613e196` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.119301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] RBAC: Authorizing `identity:get_project(project_id=7d6dae06458e40f5a42cb100a613e196)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.120780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.122517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 232/449] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/projects/7d6dae06458e40f5a42cb100a613e196 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:22.128338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.160305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4a8f-18c9-4983-8d10-869d6c2659c0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.198613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.199265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.199555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.199838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.241972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f668-18f1-4321-bab6-c935c10958a3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.268401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.269912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.275876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.276734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.277051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.277336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] PATH_INFO: `/v3/groups/21521c2b786e4411b92200159174b850` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.278522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] RBAC: Authorizing `identity:get_group(group_id=21521c2b786e4411b92200159174b850)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.279962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.281610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 233/450] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/groups/21521c2b786e4411b92200159174b850 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:22.287829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.297322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.309846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.372487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 218/451] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:05:22.378214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.391645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fb6c-10b8-482a-bc92-bb456ab00113 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.425432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.426081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.426361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.426639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.427528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] RBAC: Adding query filter params (group.id=21521c2b786e4411b92200159174b850, role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=7d6dae06458e40f5a42cb100a613e196) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:22.427840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.429360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.435063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 234/452] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/role_assignments?group.id=21521c2b786e4411b92200159174b850&scope.project.id=7d6dae06458e40f5a42cb100a613e196&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:22.482082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5fe36-28da-4266-98ee-e84ab9648e8a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.512016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.521871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.522788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.523072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.523349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] PATH_INFO: `/v3/projects/5987f6dac2ef4657891f4fdf482bda82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.524656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] RBAC: Authorizing `identity:get_project(project_id=5987f6dac2ef4657891f4fdf482bda82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.526189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.527942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 219/453] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/projects/5987f6dac2ef4657891f4fdf482bda82 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:22.533841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.626144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.642736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078379-1aec-4074-b9c0-bc07eeabfd9a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.676535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a14d50-619c-44a1-aad8-0fb6719cbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.677565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a14d50-619c-44a1-aad8-0fb6719cbe8d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.677858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a14d50-619c-44a1-aad8-0fb6719cbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.678140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a14d50-619c-44a1-aad8-0fb6719cbe8d None admin] PATH_INFO: `/v3/groups/93c0841831f542469cd598791a095a6e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.679300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a14d50-619c-44a1-aad8-0fb6719cbe8d None admin] RBAC: Authorizing `identity:get_group(group_id=93c0841831f542469cd598791a095a6e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.680750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a14d50-619c-44a1-aad8-0fb6719cbe8d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.682397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 235/454] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/groups/93c0841831f542469cd598791a095a6e => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:22.688158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.786390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994afd26-d6a6-4c36-98be-776ce2a5266f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.820359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16af9d-5018-410d-88b6-9920fcaf0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.821128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16af9d-5018-410d-88b6-9920fcaf0d3f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.821411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16af9d-5018-410d-88b6-9920fcaf0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.821687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16af9d-5018-410d-88b6-9920fcaf0d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.822622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16af9d-5018-410d-88b6-9920fcaf0d3f None admin] RBAC: Adding query filter params (group.id=93c0841831f542469cd598791a095a6e, role.id=1be9be19909c40699636c4973a021627, scope.project.id=5987f6dac2ef4657891f4fdf482bda82) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:22.822936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16af9d-5018-410d-88b6-9920fcaf0d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.824360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16af9d-5018-410d-88b6-9920fcaf0d3f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.830003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 220/455] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/role_assignments?group.id=93c0841831f542469cd598791a095a6e&scope.project.id=5987f6dac2ef4657891f4fdf482bda82&role.id=1be9be19909c40699636c4973a021627 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:25.590562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a32b2-7f0c-4759-96c1-3ad7b529cbe8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.591594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a32b2-7f0c-4759-96c1-3ad7b529cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.592082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a32b2-7f0c-4759-96c1-3ad7b529cbe8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.593971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 236/456] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:25.600149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106d047-ca99-4d25-bef4-031838d8686d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.601088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106d047-ca99-4d25-bef4-031838d8686d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.601570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106d047-ca99-4d25-bef4-031838d8686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.629814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9106d047-ca99-4d25-bef4-031838d8686d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:25.632591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9106d047-ca99-4d25-bef4-031838d8686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:25.665716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77d82-3a93-4503-b4e6-4133a7b3cc04 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.666002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77d82-3a93-4503-b4e6-4133a7b3cc04 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.666526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77d82-3a93-4503-b4e6-4133a7b3cc04 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.668442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 237/457] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:25.675719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3464c-bc89-43da-9d30-a236d2737485 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.676288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3464c-bc89-43da-9d30-a236d2737485 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.676769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3464c-bc89-43da-9d30-a236d2737485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.701966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.716191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ebf3464c-bc89-43da-9d30-a236d2737485 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:25.717456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ebf3464c-bc89-43da-9d30-a236d2737485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:25.732457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 221/458] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:25.761462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106d047-ca99-4d25-bef4-031838d8686d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.855642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 238/459] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:25.880744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3464c-bc89-43da-9d30-a236d2737485 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.948976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106d047-ca99-4d25-bef4-031838d8686d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.987794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c148f0-1afb-4073-b149-6cc73f9ee8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.988941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c148f0-1afb-4073-b149-6cc73f9ee8cf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.989459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c148f0-1afb-4073-b149-6cc73f9ee8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.989937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c148f0-1afb-4073-b149-6cc73f9ee8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.999627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.007020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c148f0-1afb-4073-b149-6cc73f9ee8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.009282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c148f0-1afb-4073-b149-6cc73f9ee8cf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.025069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3464c-bc89-43da-9d30-a236d2737485 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e5c148f0-1afb-4073-b149-6cc73f9ee8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:26.034111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:26.035216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:26.036328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:26.036328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:26.036328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.036328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:26.043184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 222/460] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:26.043184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e20d15-5a5d-4583-a177-65e3e38ea5ca None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.043184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e20d15-5a5d-4583-a177-65e3e38ea5ca None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.043184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e20d15-5a5d-4583-a177-65e3e38ea5ca None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.043184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 223/461] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:26.044640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e20d15-5a5d-4583-a177-65e3e38ea5ca None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.075315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927488fb-ae84-4f51-b047-c79cbaf26f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.076356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927488fb-ae84-4f51-b047-c79cbaf26f8e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.076849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927488fb-ae84-4f51-b047-c79cbaf26f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.077338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927488fb-ae84-4f51-b047-c79cbaf26f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.089177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927488fb-ae84-4f51-b047-c79cbaf26f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.090913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927488fb-ae84-4f51-b047-c79cbaf26f8e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.094385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-927488fb-ae84-4f51-b047-c79cbaf26f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:26.113006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:26.113879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:26.115594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:26.115594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:26.115594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.115594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:26.118344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 239/462] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:26.119878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8380e-d899-4fe6-bc8b-3d5e38420da6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.120344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8380e-d899-4fe6-bc8b-3d5e38420da6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.120795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8380e-d899-4fe6-bc8b-3d5e38420da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.138847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9bc8380e-d899-4fe6-bc8b-3d5e38420da6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:26.140308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9bc8380e-d899-4fe6-bc8b-3d5e38420da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:26.159028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e20d15-5a5d-4583-a177-65e3e38ea5ca None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.195739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e1836-78d2-439d-89e3-f9be625c9cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.196410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1836-78d2-439d-89e3-f9be625c9cba None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.196701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1836-78d2-439d-89e3-f9be625c9cba None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.197032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1836-78d2-439d-89e3-f9be625c9cba None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.197765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e1836-78d2-439d-89e3-f9be625c9cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.198077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e1836-78d2-439d-89e3-f9be625c9cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.199486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e1836-78d2-439d-89e3-f9be625c9cba None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.220860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 240/463] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:26.220860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8380e-d899-4fe6-bc8b-3d5e38420da6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.222330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 224/464] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.223723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f617a-96ee-468e-a5ce-e91af2cf233c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.224685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f617a-96ee-468e-a5ce-e91af2cf233c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.225002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f617a-96ee-468e-a5ce-e91af2cf233c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.226312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 225/465] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:26.227009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f617a-96ee-468e-a5ce-e91af2cf233c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.290448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.332068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8380e-d899-4fe6-bc8b-3d5e38420da6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.335432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.340815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f617a-96ee-468e-a5ce-e91af2cf233c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.370832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ff392-e21f-4925-99ce-1be92b4f6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.371431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff392-e21f-4925-99ce-1be92b4f6375 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.371724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff392-e21f-4925-99ce-1be92b4f6375 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.372011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff392-e21f-4925-99ce-1be92b4f6375 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.372899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ff392-e21f-4925-99ce-1be92b4f6375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.373224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ff392-e21f-4925-99ce-1be92b4f6375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.374614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ff392-e21f-4925-99ce-1be92b4f6375 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.382845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.383523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.384247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.384534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.385301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.387052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.387154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 241/466] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.392709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10cca-b331-46cc-a11b-6ba99770877e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.393034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10cca-b331-46cc-a11b-6ba99770877e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.393331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca10cca-b331-46cc-a11b-6ba99770877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.407897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 226/467] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:26 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:26.410875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ca10cca-b331-46cc-a11b-6ba99770877e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:26.412260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ca10cca-b331-46cc-a11b-6ba99770877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:26.417979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.523374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 242/468] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:26.524703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca10cca-b331-46cc-a11b-6ba99770877e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.564784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ebb29-2942-4990-b9aa-a21b8e400c5c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.598306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.610517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.611496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.611854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.612258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.625239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.627166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:26.653863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:26.654798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:26.655665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:26.655665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:26.655665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.655665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:26.655665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 227/469] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:26.655665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.667901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.670958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca10cca-b331-46cc-a11b-6ba99770877e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.715585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.716264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.716548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.716845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.717616 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.719066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.742446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 243/470] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:26 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:26.743846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.796150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968bad0-0b62-4dd6-9aa1-5b2938724a87 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.840279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ef16f-a687-4602-9b34-a112365f55ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.841568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ef16f-a687-4602-9b34-a112365f55ca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.842118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ef16f-a687-4602-9b34-a112365f55ca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.842594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ef16f-a687-4602-9b34-a112365f55ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.856237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ef16f-a687-4602-9b34-a112365f55ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.858236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ef16f-a687-4602-9b34-a112365f55ca None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.875820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44bce-07eb-4f3a-b888-8cddee252b72 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-791ef16f-a687-4602-9b34-a112365f55ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:26.879557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:26.880671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:26.881643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:26.881643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:26.881643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:26.881643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:26.883816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 228/471] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:26.885486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64037c9-3d3d-41c6-8c27-045d25f720ca None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.885992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64037c9-3d3d-41c6-8c27-045d25f720ca None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.886477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64037c9-3d3d-41c6-8c27-045d25f720ca None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.887872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.888501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 229/472] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:26.894900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64037c9-3d3d-41c6-8c27-045d25f720ca None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.930268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1d96b-6f4a-401e-b6e1-a3f623ba29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.930936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d96b-6f4a-401e-b6e1-a3f623ba29ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.931226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d96b-6f4a-401e-b6e1-a3f623ba29ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.931503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d96b-6f4a-401e-b6e1-a3f623ba29ca None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.932232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d96b-6f4a-401e-b6e1-a3f623ba29ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.932540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d96b-6f4a-401e-b6e1-a3f623ba29ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.933975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d96b-6f4a-401e-b6e1-a3f623ba29ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.951745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 244/473] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.953473 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1e330-b483-4aed-ba0d-7b0c8a238fae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.953766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1e330-b483-4aed-ba0d-7b0c8a238fae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.954048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1e330-b483-4aed-ba0d-7b0c8a238fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.975694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b9f1e330-b483-4aed-ba0d-7b0c8a238fae None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:26.977038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9f1e330-b483-4aed-ba0d-7b0c8a238fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:26.977604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.037906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64037c9-3d3d-41c6-8c27-045d25f720ca None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.057436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 245/474] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:27.058935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1e330-b483-4aed-ba0d-7b0c8a238fae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.077579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.078352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.078734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.079072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.079897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:27.080271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.082069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.096628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 230/475] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:27.097473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.190294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.194760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1e330-b483-4aed-ba0d-7b0c8a238fae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.217907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c0cf-746e-4913-91c3-f0476747989d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.241371 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.246385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.247377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.247748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.248100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.248899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.251348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.258754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.259618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.260172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.260589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.261625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.263696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.270152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.sql.core [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 04:05:27.270152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 04:05:27.270152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [parameters: {'id': 'a9dae389253442b5b4843596477d08e8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 04:05:27.270152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 04:05:27.280969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 246/476] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:27 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:27.282042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:27.289698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:27.290690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application yield resource Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise self.value Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application session.commit() Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 04:05:27.291618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.flush() Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application compat.raise_( Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 04:05:27.292537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:27.293573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:27.294402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [parameters: {'id': 'a9dae389253442b5b4843596477d08e8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:27.295194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 04:05:27.296082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:27.298628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 231/477] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jul 21 04:05:27 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:27.306963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.450829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b5ae-f2d1-422f-8346-b3a982ab09a5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.485685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976aa3c-3efa-4f6d-bcb4-9f9006a355ee None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.490010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.491016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.491309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.491586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.492294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.494147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.516914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 247/478] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:27 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:27.528736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761cce3-2f2a-4cc7-b875-018c22907081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.530088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761cce3-2f2a-4cc7-b875-018c22907081 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.530594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761cce3-2f2a-4cc7-b875-018c22907081 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.531134 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761cce3-2f2a-4cc7-b875-018c22907081 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.547000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761cce3-2f2a-4cc7-b875-018c22907081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1761cce3-2f2a-4cc7-b875-018c22907081 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:27.557234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:27.558220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:27.559080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:27.562105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 232/479] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:27.568183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.592981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.697864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4372ce-adfb-46a7-880d-b44d375b33fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.736510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee432409-3c69-452c-804e-3fe685604185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.737554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee432409-3c69-452c-804e-3fe685604185 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.738059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee432409-3c69-452c-804e-3fe685604185 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.738549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee432409-3c69-452c-804e-3fe685604185 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.740089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee432409-3c69-452c-804e-3fe685604185 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:27.740598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee432409-3c69-452c-804e-3fe685604185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.742326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee432409-3c69-452c-804e-3fe685604185 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.751843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 248/480] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:28.934163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036883a-3587-4561-8ff7-1605d9abfc1b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.935248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036883a-3587-4561-8ff7-1605d9abfc1b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.935742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036883a-3587-4561-8ff7-1605d9abfc1b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.937614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 233/481] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:28.946500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995ff4-6cab-4db8-aedf-67b61159d10d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.947297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995ff4-6cab-4db8-aedf-67b61159d10d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.947783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995ff4-6cab-4db8-aedf-67b61159d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.973828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-01995ff4-6cab-4db8-aedf-67b61159d10d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:28.975386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01995ff4-6cab-4db8-aedf-67b61159d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:29.066145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 249/482] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:29.097355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036883a-3587-4561-8ff7-1605d9abfc1b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.158517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.232566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abbe00-c8de-43ae-b616-7d2d2a5ec208 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.232864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abbe00-c8de-43ae-b616-7d2d2a5ec208 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.233059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abbe00-c8de-43ae-b616-7d2d2a5ec208 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.235752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 250/483] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:29.240342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036883a-3587-4561-8ff7-1605d9abfc1b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.240692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bc931-23af-46bc-806b-b77ca592b829 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.241241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bc931-23af-46bc-806b-b77ca592b829 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.241739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bc931-23af-46bc-806b-b77ca592b829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.265506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.271901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-863bc931-23af-46bc-806b-b77ca592b829 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:29.273126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-863bc931-23af-46bc-806b-b77ca592b829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:29.308327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.309163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.309451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.309733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.331731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:29.339617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:29.340522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:29.341383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:29.344337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 234/484] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:29.350086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.407282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 251/485] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:29.461487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bc931-23af-46bc-806b-b77ca592b829 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.485807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9a95-b7b1-4d21-ada5-8bf379f21dbf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.488464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.524850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.528866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.528866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.528866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.528866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:29.528866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.528866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.540839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 235/486] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:29.545025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.685033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877d1e-4c87-4692-a3ce-5e651ac11f68 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.704097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bc931-23af-46bc-806b-b77ca592b829 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.726966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.728111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.728626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.729148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.750849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.753494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.773749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.775181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.776552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.777229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.783590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:29.795264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:29.796177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:29.797080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:29.797080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:29.797080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:29.797080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:29.799623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 236/487] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:29.806721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.810234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:29.823550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:29.824561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:29.825437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 252/488] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:29.832191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.847668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.993182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4f74-142a-45d2-977a-2b1afb283e6a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.004924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eef3d-dc03-4039-a58e-86133ef04516 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.030283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e8318-e649-4a44-a8fd-f0f0fb2ff66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.030963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8318-e649-4a44-a8fd-f0f0fb2ff66f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.031249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8318-e649-4a44-a8fd-f0f0fb2ff66f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.031529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8318-e649-4a44-a8fd-f0f0fb2ff66f None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.032438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e8318-e649-4a44-a8fd-f0f0fb2ff66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.032795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e8318-e649-4a44-a8fd-f0f0fb2ff66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.034317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e8318-e649-4a44-a8fd-f0f0fb2ff66f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.042103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ab33b-6967-43f8-a4ab-8cd82985fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.042877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab33b-6967-43f8-a4ab-8cd82985fe60 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.043166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab33b-6967-43f8-a4ab-8cd82985fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.043446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab33b-6967-43f8-a4ab-8cd82985fe60 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.044296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ab33b-6967-43f8-a4ab-8cd82985fe60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.044610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ab33b-6967-43f8-a4ab-8cd82985fe60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.046025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ab33b-6967-43f8-a4ab-8cd82985fe60 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.048047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 237/489] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:30.049546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cfded-8026-4aef-8c44-820946ab5c32 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.049840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cfded-8026-4aef-8c44-820946ab5c32 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.050172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cfded-8026-4aef-8c44-820946ab5c32 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.051831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 238/490] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:30.054162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cfded-8026-4aef-8c44-820946ab5c32 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.059085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 253/491] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.060374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf946ef-ac6f-463b-84bb-60797c621913 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.060662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf946ef-ac6f-463b-84bb-60797c621913 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.060970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf946ef-ac6f-463b-84bb-60797c621913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.082901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6bf946ef-ac6f-463b-84bb-60797c621913 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:30.084746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6bf946ef-ac6f-463b-84bb-60797c621913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:30.139956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.143772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.169088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 254/492] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:30.170204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf946ef-ac6f-463b-84bb-60797c621913 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.171067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cfded-8026-4aef-8c44-820946ab5c32 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.209218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.210111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.210517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.211212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.219460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.221269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:30.238601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:30.241916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 239/493] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:30.244405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.299929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf946ef-ac6f-463b-84bb-60797c621913 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.335330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb8e7e-2805-40e8-a48c-201b18ed127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.336133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8e7e-2805-40e8-a48c-201b18ed127c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.336418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8e7e-2805-40e8-a48c-201b18ed127c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.336700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8e7e-2805-40e8-a48c-201b18ed127c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.349251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f1a27-da3b-472d-af4e-a47b78563498 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.349904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb8e7e-2805-40e8-a48c-201b18ed127c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.351586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb8e7e-2805-40e8-a48c-201b18ed127c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e9fb8e7e-2805-40e8-a48c-201b18ed127c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:30.371942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:30.373046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:30.373964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:30.373964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:30.373964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:30.373964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:30.373964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 255/494] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:30.374822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721174b-88ed-4e27-a3c9-e868f13c162e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.375111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721174b-88ed-4e27-a3c9-e868f13c162e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.375392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721174b-88ed-4e27-a3c9-e868f13c162e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.380857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 256/495] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:30.380857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721174b-88ed-4e27-a3c9-e868f13c162e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.393947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.394744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.395025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.395299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.402255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.406759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:30.415185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:30.416290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 240/496] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:30.417332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.425158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.486747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721174b-88ed-4e27-a3c9-e868f13c162e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.516472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0f2c5-39ba-44c1-8cd3-0249bb7311d7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.522451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c686d-fec9-4224-a249-5c4351766523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.523116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c686d-fec9-4224-a249-5c4351766523 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.523398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c686d-fec9-4224-a249-5c4351766523 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.523674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c686d-fec9-4224-a249-5c4351766523 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.524501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c686d-fec9-4224-a249-5c4351766523 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.524815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c686d-fec9-4224-a249-5c4351766523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.526273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c686d-fec9-4224-a249-5c4351766523 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.548992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825ad54-2b0b-4193-89da-cb57c3e60729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.549636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ad54-2b0b-4193-89da-cb57c3e60729 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.549919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ad54-2b0b-4193-89da-cb57c3e60729 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.550249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ad54-2b0b-4193-89da-cb57c3e60729 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.550910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825ad54-2b0b-4193-89da-cb57c3e60729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.551223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825ad54-2b0b-4193-89da-cb57c3e60729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.553296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825ad54-2b0b-4193-89da-cb57c3e60729 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.564077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 257/497] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.565394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84bd20-6777-4707-a955-0c12fa9775b1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.565685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84bd20-6777-4707-a955-0c12fa9775b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.570297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84bd20-6777-4707-a955-0c12fa9775b1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.570418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 241/498] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.570418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e20a-1ee7-41ad-88b5-c6c631ab2b83 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.570418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e20a-1ee7-41ad-88b5-c6c631ab2b83 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.570418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e20a-1ee7-41ad-88b5-c6c631ab2b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.570693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 258/499] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:30.570693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84bd20-6777-4707-a955-0c12fa9775b1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.585600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9307e20a-1ee7-41ad-88b5-c6c631ab2b83 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:30.586819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9307e20a-1ee7-41ad-88b5-c6c631ab2b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:30.641214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.658877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 242/500] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:30.660052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e20a-1ee7-41ad-88b5-c6c631ab2b83 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.675560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.684487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84bd20-6777-4707-a955-0c12fa9775b1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.719483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.720163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.720452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.720735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.721519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.721835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.723229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.731290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 259/501] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.732068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.763952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e20a-1ee7-41ad-88b5-c6c631ab2b83 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.796721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.797394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.797682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.798015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.834553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2008-cd53-4f6f-820e-a8bb5fb84d40 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.853548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.866742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.867768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98692-772c-4987-9c83-367e84de68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.868466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.868811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98692-772c-4987-9c83-367e84de68a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.869125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98692-772c-4987-9c83-367e84de68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.869407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98692-772c-4987-9c83-367e84de68a4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.876895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce98692-772c-4987-9c83-367e84de68a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.878346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce98692-772c-4987-9c83-367e84de68a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4ce98692-772c-4987-9c83-367e84de68a4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:30.894055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:30.895127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:30.896342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 260/502] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:30.897049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304cbe-2cef-402d-9b4d-411c5b2b3a87 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.897049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304cbe-2cef-402d-9b4d-411c5b2b3a87 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.897204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304cbe-2cef-402d-9b4d-411c5b2b3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.913034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a6304cbe-2cef-402d-9b4d-411c5b2b3a87 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:30.914220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a6304cbe-2cef-402d-9b4d-411c5b2b3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:30.927876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.969454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 243/503] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:30.970300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.984990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 261/504] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:30.985820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304cbe-2cef-402d-9b4d-411c5b2b3a87 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.061743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.075510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45a9c-c34f-42ae-bc60-5f2f2a2580a4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.090085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304cbe-2cef-402d-9b4d-411c5b2b3a87 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.109944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.110736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.111013 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.111290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.122393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.123859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.124638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.125465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.125751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.126035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.135983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.137506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:31.141295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.142148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.142994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:31.142994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:31.142994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.142994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:31.142994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 244/505] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.143265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.146081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:31.156624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.157681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.158716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:31.158716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:31.158716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.158716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:31.160539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 262/506] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.161912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.247159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ceba-e4b2-413c-b833-676b1b335dca None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.260551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796c55-731d-4cf4-a5aa-622dbb8b6daa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.280597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.281291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.281579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.281855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.282693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.283002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.284458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.294598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.295389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.296572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.296888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.307724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.309237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.309729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.322971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 245/507] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.323970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:31.327551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.328526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.329442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:31.329442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:31.329442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.329442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:31.329442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 263/508] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.329442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.385133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.423131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e70fa0-2a57-4002-9c74-1d6f680bfed9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.431769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ec621-5b74-4e18-bbc6-c2fcfd8c1d5b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.456973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.457794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.458149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.458435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.465530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.466188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.466472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.466753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.467505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.467826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.468634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:31.469434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:31.477196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.478120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:31.478938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 246/509] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.479614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.485783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 264/510] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.486594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.537631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.580113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1688df-377b-4493-8e8e-fb9f63f671be None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.586464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9deae-2f87-45c0-9008-a3f35664412a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.598911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.614179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.615374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.615655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.615934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.616650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.616997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.618632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.620770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.621451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.621738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.622022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.630728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 247/511] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.631645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.694026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.695731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.733793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407226b2-6aa9-4336-aa30-056e6b09c921 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.751315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.769606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.770267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.770578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.770857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.771571 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.771886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.773628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.785040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 248/512] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.785644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.806483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 265/513] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:31.806483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.816535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.896197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba67a5-8112-4fbc-bdf8-209c90e43a2c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.901684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b982b-85cc-4e6e-a463-7b3ef7a48ae6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.930061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.930657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.930942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.931228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.931970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.932281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.933694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.935632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.936293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.936575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.936878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.937575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.938990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.941501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 249/514] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.942277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.959502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 266/515] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:31 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:31.960310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.000262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.040963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.074313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7d91-9617-424c-8d03-e0514dd72948 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.082792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b4647-f02b-40b2-bcc3-a50f56d30972 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.110266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.111074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.111357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.111638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.121518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.122990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.124752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.125245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.125245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.125648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.134925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.135886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:32.138383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:32.139272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:32.140198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 250/516] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:32.140768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:32.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:32.156532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:32.157470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 267/517] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:32.157963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.252748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.256283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989b33-d27a-4faa-97f9-312579aa9d82 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.272776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaae920-bb8b-442f-8d08-b4b225667b47 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.295705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.296512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.296800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.297197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.303738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.309130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.310594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.312814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.313971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.314261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.314546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.327011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.328482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:32.328646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:32.329504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:32.330355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:32.330355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:32.330355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:32.330355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:32.330355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 251/518] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:32.331162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:32.352951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:32.353892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:32.354731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:32.354731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:32.354731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:32.354731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:32.358904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 268/519] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:32.359746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.439346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2786-a369-49d5-aca0-efcdcf22ac1e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.464638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d629d56-6a0e-4741-aaf0-6ebe6a3b6d45 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.481201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.482510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.482948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.483374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.484357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:32.484914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.487222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.500322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.501167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.501578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.501973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.503018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:32.503284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.504735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.512619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 252/520] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:32.512619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.525804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 269/521] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:32.526276 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.526645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.572152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.634456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25f0a-7e5d-4e79-beb7-b5c6794684bd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.634714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659ee8e-291a-4d09-a6e4-e031c3d5ff36 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.676487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.677733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.678023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.678346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.679027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:32.679334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.679760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.680540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.680729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.681052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.681434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.682270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:32.682683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.684181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.692962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 253/522] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:32.693678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.702539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 270/523] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:32.704096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.767784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.803544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ace44-620f-4895-9a29-91ef5c3fa4d5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.813085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.816599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69b9b7-3dde-4f38-bdae-959e23a15147 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.838405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.839054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.839344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.839627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.853922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.854568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.854853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.855136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.855961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=31fbd8b38e80472e83ee62084cd19d3e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:32.856274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.857747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.863575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 271/524] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/role_assignments?user.id=31fbd8b38e80472e83ee62084cd19d3e&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:32.864868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.933435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.935326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.977006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff539ae-5c63-450c-bb27-444060b5c61e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.015022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.016010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.016363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.016739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.017977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.025992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.027584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:33.042501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:33.043575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:33.044723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:33.047157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 272/525] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:33.047157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.069626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 254/526] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:33.070776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.079838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.167904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22ad8-32d5-4176-9cac-94d913a07472 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.177960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafabd9-d5c9-4fc0-a5d6-500fcfc337dd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.207067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.207874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.208209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.208501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.215609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.216554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.216677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.217181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.217681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.218088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.218907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:33.219434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.221090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:33.233930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:33.234866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:33.235841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:33.240347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 273/527] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:33.241326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.244007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 255/528] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:33.245065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.277256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.343134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.353041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc745d35-655f-4265-bfb9-4f293e0ae3dd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.363294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaf061-8c55-48a1-ae3c-770881a39c27 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.389899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.390901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.391389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.391870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.392956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:33.393474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.395149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.402437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.403232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.403521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.403805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.415308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 256/529] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:33.416406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.419981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.421615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:33.442388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:33.443322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:33.444187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:33.444187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:33.444187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:33.444187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:33.444187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 274/530] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:33.444991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.514126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.527574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa34d16-91bc-4d85-a5c8-3cf981f06f86 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.560254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf186a-5bc1-4c48-9d86-3699fca8b303 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.564042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.564407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.564794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.565205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.566148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=061cc3a23d944f18b311eb2aa9a651d9) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:33.566573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.568519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.574629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 257/531] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/role_assignments?user.id=061cc3a23d944f18b311eb2aa9a651d9&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:33.575525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.617558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.618759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.619248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.619848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.625061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.689320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5e45-b9be-4808-9818-238c9e7a6248 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.734249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.734985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.735220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.735502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.736242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:33.736773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.738103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.750957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.752871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.762069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 258/532] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:33.767532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.790366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.876751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 275/533] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:33.878623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.918721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.976381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd1eb2-4034-4814-a3ba-b4435e9e118b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.013349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.014459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.015088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.015566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.024290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.026311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:34.043383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:34.044269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:34.045151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:34.047431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 259/534] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:34.053960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.061366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e1e6f-cefa-4ceb-975f-6d0d5b273869 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.122920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56241162-9128-4efa-bd67-474665b6aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.124282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241162-9128-4efa-bd67-474665b6aced None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.124568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241162-9128-4efa-bd67-474665b6aced None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.124873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241162-9128-4efa-bd67-474665b6aced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.139789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56241162-9128-4efa-bd67-474665b6aced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.142235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56241162-9128-4efa-bd67-474665b6aced None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.156862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-56241162-9128-4efa-bd67-474665b6aced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:34.167972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:34.169208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:34.170060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:34.170060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:34.170060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:34.170060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:34.170060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 276/535] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:34.172873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5ec9-79e9-41b1-85c2-754941fb8c80 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.172873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5ec9-79e9-41b1-85c2-754941fb8c80 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.172873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5ec9-79e9-41b1-85c2-754941fb8c80 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.177251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 277/536] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:34.178619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de5ec9-79e9-41b1-85c2-754941fb8c80 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.198250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0e34-ce2d-4683-827b-50ee8a0e4b1f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.235329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81cf2a-2257-45aa-be7b-bc0a6fc025cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.236130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81cf2a-2257-45aa-be7b-bc0a6fc025cc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.236501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81cf2a-2257-45aa-be7b-bc0a6fc025cc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.236917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81cf2a-2257-45aa-be7b-bc0a6fc025cc None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.237773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81cf2a-2257-45aa-be7b-bc0a6fc025cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:34.238155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81cf2a-2257-45aa-be7b-bc0a6fc025cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.239801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81cf2a-2257-45aa-be7b-bc0a6fc025cc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.253221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 260/537] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:34.255433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904d93b-68c1-495f-87cc-bdd379de21fb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.255932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904d93b-68c1-495f-87cc-bdd379de21fb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.256254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904d93b-68c1-495f-87cc-bdd379de21fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.275774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d904d93b-68c1-495f-87cc-bdd379de21fb None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:34.277011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d904d93b-68c1-495f-87cc-bdd379de21fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:34.297368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.316088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de5ec9-79e9-41b1-85c2-754941fb8c80 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.356425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 261/538] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:34.357317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904d93b-68c1-495f-87cc-bdd379de21fb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.369613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.370287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.370573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.376865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.376865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:34.376865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.376865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.392293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 278/539] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:34.393157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.453301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.502914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5bdba-ec19-4984-a141-f75ba8836003 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.505167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904d93b-68c1-495f-87cc-bdd379de21fb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.543296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.544199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.544490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.544769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.553663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.554249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.554531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.554809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.556003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=473f1bd4a95f4899a4a9a9927f14738c) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:34.556223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:34.556388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.557811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.563543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 262/540] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/role_assignments?user.id=473f1bd4a95f4899a4a9a9927f14738c&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:34.564326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:34.564504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:34.566586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:34.568630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 279/541] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:34.584524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.603981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.751302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95585dd-2490-4ead-8a72-b9af54a0fbfe None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.796646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.807206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.808413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.808697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.809004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.816559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.819034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:34.835336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:34.837431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:34.839500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 263/542] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:34.840607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852c690-90f0-41b6-9c9e-bf2b8e1c77e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.845801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.884604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.885359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.885647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.885982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.886735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:34.887046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.888494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.909259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 280/543] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:34.915470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.986197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fed05-2216-4c0d-8439-64dcba5a0213 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.025295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.025958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.026249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.026518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.027300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:35.027610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.029085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.052939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 264/544] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:35.057830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.075662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.120122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.122005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610468f-65e7-4462-a844-2b300794afcb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.170782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb290d-9dcc-4013-9b39-6fda628f7dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.172851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb290d-9dcc-4013-9b39-6fda628f7dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.173543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb290d-9dcc-4013-9b39-6fda628f7dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.173980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb290d-9dcc-4013-9b39-6fda628f7dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.186080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f91169-200c-4588-b567-6ac26d3de04d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.189940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb290d-9dcc-4013-9b39-6fda628f7dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.191563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb290d-9dcc-4013-9b39-6fda628f7dc7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-78bb290d-9dcc-4013-9b39-6fda628f7dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:35.215079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.216158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.217269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:35.217269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:35.217269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:35.217269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:35.219994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 281/545] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:35.221647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74ad78-d16e-4a56-b043-10d9b16133b8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.222479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74ad78-d16e-4a56-b043-10d9b16133b8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.222914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74ad78-d16e-4a56-b043-10d9b16133b8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.229655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 282/546] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:35.229783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afd236-cf87-4ab2-b987-975c2eb60f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.229783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd236-cf87-4ab2-b987-975c2eb60f46 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.229783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd236-cf87-4ab2-b987-975c2eb60f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.229783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd236-cf87-4ab2-b987-975c2eb60f46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.230945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd236-cf87-4ab2-b987-975c2eb60f46 None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=7456efd79db1474fa9f0b392d9c7e4ce) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:35.231374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd236-cf87-4ab2-b987-975c2eb60f46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.231572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74ad78-d16e-4a56-b043-10d9b16133b8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.233074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd236-cf87-4ab2-b987-975c2eb60f46 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.244915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 265/547] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/role_assignments?user.id=7456efd79db1474fa9f0b392d9c7e4ce&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:35.246566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03602-be49-49f8-b096-e685e30a1087 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.248944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03602-be49-49f8-b096-e685e30a1087 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.249420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c03602-be49-49f8-b096-e685e30a1087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.281539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f0c03602-be49-49f8-b096-e685e30a1087 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:35.284694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f0c03602-be49-49f8-b096-e685e30a1087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:35.406840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74ad78-d16e-4a56-b043-10d9b16133b8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.442112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.443460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 266/548] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:35.455630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.456531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.457057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.457485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.459051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:35.459511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.461220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.475154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 283/549] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:35.477796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c03602-be49-49f8-b096-e685e30a1087 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.480197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.559114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.626920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d92a6-b0f5-4c05-b5ab-fc58027a5cc5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.670820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.671979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.671979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.672111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.684013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.685517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.701085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c03602-be49-49f8-b096-e685e30a1087 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:35.711247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.712700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:35.713861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:35.716956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 284/550] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:35.721762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.746265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.747581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.748112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.748593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.761206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:35.769985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.771884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:35.772704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:35.776012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 267/551] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:35.798391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.802788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.867602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd40c2-1b87-4b2d-b4f1-25e31f85dd8c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.908296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.908999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.909291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.909578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.910432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:35.910749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.913053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.934337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 285/552] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:35.940178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.005095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.008208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133429-0380-4c0f-b885-61b6c28c5de8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.048796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.049953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.050320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.050673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.051504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.051914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.053942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.068432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 268/553] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:36.069932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.115408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.119614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaa113-a16c-4326-b80f-3d28fac5188a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.160321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0994f-43f4-48ae-a00f-c06900c12a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.161737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0994f-43f4-48ae-a00f-c06900c12a0b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.162159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0994f-43f4-48ae-a00f-c06900c12a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.162455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0994f-43f4-48ae-a00f-c06900c12a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.212064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339cc4-5492-47e4-a417-3f7a8b0aa0e3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.234082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0994f-43f4-48ae-a00f-c06900c12a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.235547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0994f-43f4-48ae-a00f-c06900c12a0b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.259380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53022b61-321a-47d0-8e17-d3c8846364b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.260471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53022b61-321a-47d0-8e17-d3c8846364b7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.260761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53022b61-321a-47d0-8e17-d3c8846364b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.261330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53022b61-321a-47d0-8e17-d3c8846364b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.276627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53022b61-321a-47d0-8e17-d3c8846364b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.278670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53022b61-321a-47d0-8e17-d3c8846364b7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-53022b61-321a-47d0-8e17-d3c8846364b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:36.303238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:36.304175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:36.305093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:36.305093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:36.305093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.305093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:36.310224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 269/554] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.310224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbab29-a804-49bf-b6d0-cab4b047561e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.310224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbab29-a804-49bf-b6d0-cab4b047561e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.310224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbab29-a804-49bf-b6d0-cab4b047561e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.312632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 270/555] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:36.318736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbab29-a804-49bf-b6d0-cab4b047561e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.342720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.354541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.359517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 286/556] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:36.361198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b4fdf-f6dd-46f0-89f6-6278ec2ac0b1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.361634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b4fdf-f6dd-46f0-89f6-6278ec2ac0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.361956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b4fdf-f6dd-46f0-89f6-6278ec2ac0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.380533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-796b4fdf-f6dd-46f0-89f6-6278ec2ac0b1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:36.382033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-796b4fdf-f6dd-46f0-89f6-6278ec2ac0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:36.463633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 287/557] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:36.464783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b4fdf-f6dd-46f0-89f6-6278ec2ac0b1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.474169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbab29-a804-49bf-b6d0-cab4b047561e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.523513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.524416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.524799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.525263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.526089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.526502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.528029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.547466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 271/558] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.547466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.592740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b4fdf-f6dd-46f0-89f6-6278ec2ac0b1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.627764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.636438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.637636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.638028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.638410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.650908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.653683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.657000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:36.683010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:36.684100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:36.685253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:36.685253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:36.685253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.685253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:36.685885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3ec9-48cd-462f-81fe-9ac7355fac78 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.687562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 288/559] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.689336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.731834 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.732561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.732906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.733147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.744396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:36.752188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:36.753174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 272/560] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.759466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.799755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4081aec-b83f-4a11-9b1e-5bb77de534e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.835471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a7fc-d99f-44f0-b1b4-6f2370f18ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.836267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a7fc-d99f-44f0-b1b4-6f2370f18ffb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.836551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a7fc-d99f-44f0-b1b4-6f2370f18ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.836853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a7fc-d99f-44f0-b1b4-6f2370f18ffb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.844425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950a7fc-d99f-44f0-b1b4-6f2370f18ffb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.845901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950a7fc-d99f-44f0-b1b4-6f2370f18ffb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9950a7fc-d99f-44f0-b1b4-6f2370f18ffb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:36.860911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:36.861874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:36.862831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 289/561] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.864643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb5c7b-3f68-434a-87a4-304586ee384c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.864643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb5c7b-3f68-434a-87a4-304586ee384c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.864643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb5c7b-3f68-434a-87a4-304586ee384c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.865578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 290/562] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:36.870369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb5c7b-3f68-434a-87a4-304586ee384c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.872463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f048cf-a328-49e0-abd0-9e7fe63a46f8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.907627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.909007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.909007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.909007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.909575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.909887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.912047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.913676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.920259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.929014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 273/563] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.929014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.989789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb5c7b-3f68-434a-87a4-304586ee384c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.024751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59fab8-7542-4e84-bd9d-7621a556d4b5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.026697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfa44a-e188-4cc5-9321-8e2c8e976ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.027580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa44a-e188-4cc5-9321-8e2c8e976ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.027930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa44a-e188-4cc5-9321-8e2c8e976ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.028276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa44a-e188-4cc5-9321-8e2c8e976ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.030472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfa44a-e188-4cc5-9321-8e2c8e976ab5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.030864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfa44a-e188-4cc5-9321-8e2c8e976ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.032426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfa44a-e188-4cc5-9321-8e2c8e976ab5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.046205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 291/564] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.046205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103d86-e3db-4b11-ad5c-3543d124d11f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.046205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103d86-e3db-4b11-ad5c-3543d124d11f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.046205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103d86-e3db-4b11-ad5c-3543d124d11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.062450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6f103d86-e3db-4b11-ad5c-3543d124d11f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:37.063557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.063774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6f103d86-e3db-4b11-ad5c-3543d124d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:37.064231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.064510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.064789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.065653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.065976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.067602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.085879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 274/565] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.086696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.140904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.142347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 292/566] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:37.143408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f103d86-e3db-4b11-ad5c-3543d124d11f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.186621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.197444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7fa3-5df3-44f0-a3a8-d999d3fa3136 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.232930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.233739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.234023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.234302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.241703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.243420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.256253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f103d86-e3db-4b11-ad5c-3543d124d11f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:37.258061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:37.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 275/567] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:37.260216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.297330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.298128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.298411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.298693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.309390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.310857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:37.329369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:37.330458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:37.331388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:37.331388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:37.331388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:37.331388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:37.331388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 293/568] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:37.331388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.376065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbe9fc-f726-44a7-abce-6a296b0635a6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.389963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.414460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.415262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.415551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.415830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.426494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.429090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.430561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.443953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c62b4-25b5-4506-9269-1844665f6807 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:37.449095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:37.449957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:37.455644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:37.455644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:37.455644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:37.455644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:37.455644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 276/569] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:37.455644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.486863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.487837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.488196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.488511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.499933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:37.507870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:37.508802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:37.509694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 294/570] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:37.510412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.565659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76208e7-9f31-413c-8575-ad676e2ac790 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.601574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.602458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.602747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.603033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.603822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.604140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.605654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.613523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b93f-675e-49d5-ab8e-cf652b820589 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.618327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 277/571] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.618949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.643598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.647990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.648651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.648966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.649247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.649974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.650281 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.651706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.664631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 295/572] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.665568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.674209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.726172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46959c-d7f2-4c98-8a0a-20c6ef9f0164 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.759369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2be5a-abb3-43f3-82eb-e2abed757fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.760034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2be5a-abb3-43f3-82eb-e2abed757fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.760325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2be5a-abb3-43f3-82eb-e2abed757fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.760612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2be5a-abb3-43f3-82eb-e2abed757fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.761370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2be5a-abb3-43f3-82eb-e2abed757fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.761682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2be5a-abb3-43f3-82eb-e2abed757fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.763071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2be5a-abb3-43f3-82eb-e2abed757fd7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.763844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6458e-3bac-410f-9692-b094d4f29b42 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.775187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 278/573] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.776505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8decb9-d8bc-439f-b022-8fa78603e7ee None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.776886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8decb9-d8bc-439f-b022-8fa78603e7ee None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.777110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8decb9-d8bc-439f-b022-8fa78603e7ee None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.779981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 279/574] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:37.779981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8decb9-d8bc-439f-b022-8fa78603e7ee None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.801464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.802164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.802562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.802741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.803485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.803798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.805209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.813062 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 296/575] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.813834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.868207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.883417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.885072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8decb9-d8bc-439f-b022-8fa78603e7ee None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.917455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3453e4-b126-4808-a5f0-35f594b6b40e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.925025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.925680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.925966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.926648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.927974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=65e73243951044e4b5beb3de4ebb0a8f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.928298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.929764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.935082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 280/576] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/role_assignments?user.id=65e73243951044e4b5beb3de4ebb0a8f&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.935855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.953899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff929c52-d109-4540-b9bb-478ef8f0e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.954865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929c52-d109-4540-b9bb-478ef8f0e84f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.955278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929c52-d109-4540-b9bb-478ef8f0e84f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.955567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929c52-d109-4540-b9bb-478ef8f0e84f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.966899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff929c52-d109-4540-b9bb-478ef8f0e84f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.968408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff929c52-d109-4540-b9bb-478ef8f0e84f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ff929c52-d109-4540-b9bb-478ef8f0e84f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:37.984836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:37.986057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:37.987185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 297/577] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:37.987901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982966-1b66-4c24-98c5-237b221735a2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.988204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982966-1b66-4c24-98c5-237b221735a2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.988386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982966-1b66-4c24-98c5-237b221735a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.013566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d1982966-1b66-4c24-98c5-237b221735a2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:38.014725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d1982966-1b66-4c24-98c5-237b221735a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:38.062094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44196e30-f659-4664-90d5-fb5d6b975b6a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.090471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 298/578] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:38.091461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982966-1b66-4c24-98c5-237b221735a2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.106024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.106929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.107243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.107606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.115564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.117052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:38.133456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.134437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:38.135376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:38.139422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 281/579] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:38.140009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.157268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.169273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.209189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982966-1b66-4c24-98c5-237b221735a2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.246295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.247086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.247367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.247665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.254774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b26a-2c30-4a3d-be24-87374bd49673 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.258390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.260512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:38.280531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.281525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.282443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:38.282443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:38.282443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:38.282443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:38.282443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 299/580] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:38.283331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.299156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.299886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.300094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.300371 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.301247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.302074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.303823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.323780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 282/581] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:38.324590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.398036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.400512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaef79-1815-429b-8534-5d64217f1150 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.413308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.435798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ffda-98b3-4e0a-afde-b6ef924cf131 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.443011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.443924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.444703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.445106 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.456795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:38.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.466378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 300/582] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:38.472265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.480222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.480950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.481226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.481507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.482407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.482738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.484178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.501329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 283/583] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:38.501329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.580492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07e933-ff69-405c-9136-6db7104f0b56 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.599820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61075-9716-4c38-8ef7-5604a00f16fd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.616764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.617537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.618157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.618516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.619317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.619702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.621183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.626813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.638422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 301/584] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:38.638422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.638658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.638907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.639124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.639406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.653952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.653952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:38.671778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.672680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.673613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:38.673613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:38.673613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:38.673613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:38.673613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 284/585] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:38.673895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.678102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.749726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89651b2-8f45-4413-9c02-99f60926e3d1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.780050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f278a6-c7e1-4ea7-a6a5-629dbffa90d6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.785664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.786368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.786659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.786947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.787703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.788015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.789439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.801699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 302/586] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:38.801699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.822810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.824021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.824583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.824893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/31fbd8b38e80472e83ee62084cd19d3e/roles/4dcc6b65bf2143728b2d8ba9b04eadb7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.841562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=31fbd8b38e80472e83ee62084cd19d3e, role_id=4dcc6b65bf2143728b2d8ba9b04eadb7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.843182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.857849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 285/587] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:38 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/31fbd8b38e80472e83ee62084cd19d3e/roles/4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:38.870285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.899698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.911910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb45cd-96e0-4463-bae7-b7e7803a1dca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.917633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.957370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.959148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.959602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.959984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.972517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.974971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:38.993258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.994302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:38.995436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 303/588] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:38.996276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.025465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b4d97-281d-46ce-837f-b06172bcb935 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.068245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.069068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.069469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.069877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.070733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.071159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.072703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.088855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 286/589] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.088855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.127443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51858ed-826c-4ae7-9c88-bc8cbc52353b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.171711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.173140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.173428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.173714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.187383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.189942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.193345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.202281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1346-9828-46e2-9e3c-bd509cc9f4ba None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:39.216202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:39.217366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:39.218283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:39.218283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:39.218283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:39.218283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:39.218519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 304/590] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:39.224248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.224248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.245963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.246687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.246974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.247308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.248202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.248528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.250053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.274877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 287/591] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.275868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.351558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef9cf9-a786-4473-bbb9-b1209308f4f9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.394455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.396268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.397053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.397544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.398543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb78e-1ec0-4d14-84a0-ad96e39bc87d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.407298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.409949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:39.432099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:39.433092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:39.434021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:39.440872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.440872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.440872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.440872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.441251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.441251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.441251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.442373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 305/592] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:39.444091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.453216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 288/593] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.454107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.463945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.531692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.564796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242dc7-1497-4350-9ccb-46db93c4f12a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.574752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec385e7-52b8-4510-aac5-b5cdf5e37f74 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.601411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.601970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.602254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.602540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.603398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.603634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.605105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.614096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.615953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.616447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.616969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.623716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 289/594] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.623716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.635840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.637407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:39.661682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:39.662650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:39.663564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:39.663564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:39.663564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:39.663564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:39.663564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 306/595] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:39.664311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.705999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.743788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39a3ab-4b48-409f-95db-8e7b02b70477 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.779010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.779906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.780195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.780475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.783418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4cd1b-bf4d-45a8-924e-d5380c4882b3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.788800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.790287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.804019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:39.807066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:39.808062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:39.809073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 290/596] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:39.809690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.828485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.829945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.830494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.831029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/061cc3a23d944f18b311eb2aa9a651d9/roles/4dcc6b65bf2143728b2d8ba9b04eadb7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.853690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=061cc3a23d944f18b311eb2aa9a651d9, role_id=4dcc6b65bf2143728b2d8ba9b04eadb7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.855638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.881100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 307/597] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:39 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/061cc3a23d944f18b311eb2aa9a651d9/roles/4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:39.881100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.995216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d832a-9625-4b9a-a3df-6aef212929ed None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.034864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beeb63-6209-46e2-b3db-f871ab6eec44 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.061234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.070144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600ddd7-6185-4cd6-894c-feee20ce44ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.070513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ddd7-6185-4cd6-894c-feee20ce44ea None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.070821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ddd7-6185-4cd6-894c-feee20ce44ea None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.071217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600ddd7-6185-4cd6-894c-feee20ce44ea None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.071965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600ddd7-6185-4cd6-894c-feee20ce44ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:40.072281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600ddd7-6185-4cd6-894c-feee20ce44ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.075195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600ddd7-6185-4cd6-894c-feee20ce44ea None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.081093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c2ec-6d0f-4ab0-abca-7e337f096e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.082092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c2ec-6d0f-4ab0-abca-7e337f096e8d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.082487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c2ec-6d0f-4ab0-abca-7e337f096e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.083492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c2ec-6d0f-4ab0-abca-7e337f096e8d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.084467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c2ec-6d0f-4ab0-abca-7e337f096e8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:40.085219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c2ec-6d0f-4ab0-abca-7e337f096e8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.086642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c2ec-6d0f-4ab0-abca-7e337f096e8d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.100869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 291/598] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:40.100869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6742ed-5771-449b-9ad4-1aff49954ecb None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.100869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6742ed-5771-449b-9ad4-1aff49954ecb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.100869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6742ed-5771-449b-9ad4-1aff49954ecb None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.100869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 292/599] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:40.100869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6742ed-5771-449b-9ad4-1aff49954ecb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.117651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 308/600] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:40.119337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935fc8-8e2f-4bc2-97c3-32033cdefba5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.119735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935fc8-8e2f-4bc2-97c3-32033cdefba5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.120126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935fc8-8e2f-4bc2-97c3-32033cdefba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.141983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b4935fc8-8e2f-4bc2-97c3-32033cdefba5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:40.143358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4935fc8-8e2f-4bc2-97c3-32033cdefba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:40.165320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.221920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 309/601] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:40.222999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935fc8-8e2f-4bc2-97c3-32033cdefba5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.224138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6742ed-5771-449b-9ad4-1aff49954ecb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.262609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.263651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.264113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.264559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.272982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.274794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:40.290191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:40.291139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:40.292061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:40.294756 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 293/602] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:40.300359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.330636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935fc8-8e2f-4bc2-97c3-32033cdefba5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.353638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.368650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02839-b007-4837-b022-214c29ad967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.369579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02839-b007-4837-b022-214c29ad967c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.370187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02839-b007-4837-b022-214c29ad967c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.370187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02839-b007-4837-b022-214c29ad967c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.381374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac02839-b007-4837-b022-214c29ad967c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.383671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac02839-b007-4837-b022-214c29ad967c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bac02839-b007-4837-b022-214c29ad967c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:40.402313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:40.403265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:40.404174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:40.404174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:40.404174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:40.404174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:40.404174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 310/603] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:40.409372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02839-b007-4837-b022-214c29ad967c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.418555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.420083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c9fed-0300-4778-b4a1-dc44fbb69728 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.461806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.462910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.463381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.463953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.477730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:40.488758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:40.490244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:40.491097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:40.493992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 294/604] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:40.495096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.519021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02839-b007-4837-b022-214c29ad967c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.554925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.555652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.555940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.556223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.557158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:40.557477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.558957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.577426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 311/605] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:40.577426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.614905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd15b-b9e4-46d5-babf-a1ef59d9ad04 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.623371 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.644310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.662043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.663162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.663659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.664150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.665170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:40.665938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.667653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.681766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 295/606] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:40.682930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.688810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12042-1a93-44f9-9738-8e3815ef070c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.725881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.726556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.726843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.727123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.727882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:40.728190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.729609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.738390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 312/607] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:40.740370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.812159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b1fae-56f7-40a9-99c0-e8d07c45105d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.848136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.849764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.850183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.850473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/473f1bd4a95f4899a4a9a9927f14738c/roles/4dcc6b65bf2143728b2d8ba9b04eadb7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.858207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb9fb-ddc1-4fe3-9a14-0647797a6376 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.867187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=473f1bd4a95f4899a4a9a9927f14738c, role_id=4dcc6b65bf2143728b2d8ba9b04eadb7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.869005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.886305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 296/608] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:40 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/473f1bd4a95f4899a4a9a9927f14738c/roles/4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:40.887423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.894894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.906272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.907400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.907687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.907966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.915207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.919626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.922280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:40.953786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:40.954767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:40.955783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:40.958764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 313/609] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:40.963529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.093576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09c90-05c0-4e49-8113-168d7bf3028b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.139526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88986-b2e3-47ab-be47-801bdd199119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.140340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88986-b2e3-47ab-be47-801bdd199119 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.140631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88986-b2e3-47ab-be47-801bdd199119 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.140963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88986-b2e3-47ab-be47-801bdd199119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.141648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fadbc-fcfd-438c-a526-37ce1ba0426b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.153750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da88986-b2e3-47ab-be47-801bdd199119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.155592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da88986-b2e3-47ab-be47-801bdd199119 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0da88986-b2e3-47ab-be47-801bdd199119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:41.176245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:41.177992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:41.178920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:41.178920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:41.178920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:41.178920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:41.179578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe156a-46cc-4fbf-90d4-8f0326192ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.179964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe156a-46cc-4fbf-90d4-8f0326192ddc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.180256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe156a-46cc-4fbf-90d4-8f0326192ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.180538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe156a-46cc-4fbf-90d4-8f0326192ddc None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.181380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe156a-46cc-4fbf-90d4-8f0326192ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.181695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe156a-46cc-4fbf-90d4-8f0326192ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.182439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 297/610] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:41.183166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe156a-46cc-4fbf-90d4-8f0326192ddc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.184304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac3acb-70ea-4770-a255-46655ab0d30c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.184793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac3acb-70ea-4770-a255-46655ab0d30c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.185552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac3acb-70ea-4770-a255-46655ab0d30c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.187420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 298/611] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:41.188307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac3acb-70ea-4770-a255-46655ab0d30c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.203854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 314/612] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:41.210196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d3a7-7acb-4300-b340-fc1510391179 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.210196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d3a7-7acb-4300-b340-fc1510391179 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.210196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d3a7-7acb-4300-b340-fc1510391179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.224888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0b05d3a7-7acb-4300-b340-fc1510391179 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:41.226281 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b05d3a7-7acb-4300-b340-fc1510391179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:41.269140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.278711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.306380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 315/613] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:41.309506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d3a7-7acb-4300-b340-fc1510391179 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.318417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac3acb-70ea-4770-a255-46655ab0d30c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.366274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.367234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.367707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.368417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.369387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.369912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.371489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.384653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 299/614] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:41.385985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.454283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d3a7-7acb-4300-b340-fc1510391179 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.494668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334dd7-5991-43c0-9e38-4db815d2fe66 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.501083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.501989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.502702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.503056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/7456efd79db1474fa9f0b392d9c7e4ce/roles/4dcc6b65bf2143728b2d8ba9b04eadb7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.522976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=7456efd79db1474fa9f0b392d9c7e4ce, role_id=4dcc6b65bf2143728b2d8ba9b04eadb7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.523179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.524947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.532885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.533707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.533978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.534260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.543172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 316/615] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:41 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/7456efd79db1474fa9f0b392d9c7e4ce/roles/4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:41.544437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.545736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:41.554797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:41.555861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:41.556758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 300/616] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:41.562818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.605197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.752178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a48675-c8c1-4f84-b64e-8676c0a31d97 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.777749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ed586-4251-4961-884f-65aa87638c80 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.800723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.802905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.803406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.803868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.814703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.816741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.824158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.824973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.825328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.825683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.826601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.826985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.828750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:41.838270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:41.839238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:41.840209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:41.840768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 301/617] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:41.842490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 317/618] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:41.845790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.849865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.925267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.949330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.963311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f53ab-4108-4394-b9b3-46543023ffaf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.004601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.006300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.006745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.007173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.008161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.008631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.010551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.032005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 318/619] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.038157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f2fa-ee12-4944-a903-9739f65f1cb8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.042834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.097439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3dac-0fb3-4d73-95d2-17382fa06bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.098320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3dac-0fb3-4d73-95d2-17382fa06bfe None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.099294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3dac-0fb3-4d73-95d2-17382fa06bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.099581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3dac-0fb3-4d73-95d2-17382fa06bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.115212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3dac-0fb3-4d73-95d2-17382fa06bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.116673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3dac-0fb3-4d73-95d2-17382fa06bfe None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c5eb3dac-0fb3-4d73-95d2-17382fa06bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:42.134934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.136088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 302/620] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f347d-352d-4403-bd58-8f3e78dcdd16 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f347d-352d-4403-bd58-8f3e78dcdd16 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f347d-352d-4403-bd58-8f3e78dcdd16 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.141343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 303/621] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:42.146780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f347d-352d-4403-bd58-8f3e78dcdd16 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.196474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383714-9227-4586-8b0f-5e3b8f0f2dcf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.235519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa4921-6786-4c63-8768-0ac4bf6dd636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.236703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa4921-6786-4c63-8768-0ac4bf6dd636 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.237158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa4921-6786-4c63-8768-0ac4bf6dd636 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.237600 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa4921-6786-4c63-8768-0ac4bf6dd636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.250186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa4921-6786-4c63-8768-0ac4bf6dd636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.251862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa4921-6786-4c63-8768-0ac4bf6dd636 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.259844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.265226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f347d-352d-4403-bd58-8f3e78dcdd16 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.267059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-19aa4921-6786-4c63-8768-0ac4bf6dd636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:42.274134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.275249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.276361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:42.276361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:42.276361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:42.276361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:42.278384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 319/622] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.279878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021f80-6929-46f7-9347-7f49111c9af5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.280239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021f80-6929-46f7-9347-7f49111c9af5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.280589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021f80-6929-46f7-9347-7f49111c9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.299399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-95021f80-6929-46f7-9347-7f49111c9af5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:42.300682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95021f80-6929-46f7-9347-7f49111c9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:42.310745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.311805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.312242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.312742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.313634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.314146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.315764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.328473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 304/623] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.329557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.385251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 320/624] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:42.386135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021f80-6929-46f7-9347-7f49111c9af5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.437196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac151c7-baa4-411b-849e-709cd3b3e7a2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.473589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.474554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.475027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.475491 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.476393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.476909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.478483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.491939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 305/625] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.493392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.511064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021f80-6929-46f7-9347-7f49111c9af5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.520986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.546173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.555604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.556411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.556748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.557060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.565456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.567545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:42.584392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.585571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 321/626] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.586751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.604647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1898620-f56f-497e-9a83-45d2937824a3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.640452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e847e-e52a-48be-827f-97723b106fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.641385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e847e-e52a-48be-827f-97723b106fff None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.641750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e847e-e52a-48be-827f-97723b106fff None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.642106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e847e-e52a-48be-827f-97723b106fff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.653576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e847e-e52a-48be-827f-97723b106fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-420e847e-e52a-48be-827f-97723b106fff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:42.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.665515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:42.666564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:42.672224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 306/627] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.672224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e847e-e52a-48be-827f-97723b106fff None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.704128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd81b4d-575c-40c0-9224-5327b48d44cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.743428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.744152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.744439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.744721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.752261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.753815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.755395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:42.770843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.772076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:42.773187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:42.779822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e847e-e52a-48be-827f-97723b106fff None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.780096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 322/628] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.781122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.813306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.814086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.814450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.814808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.815727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.816115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.818452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.836584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 307/629] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.837553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.838189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.895779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff570c2f-07b9-44bf-b0cf-011430d9a3fe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.934533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.935426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.935788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.936140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.937008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.937395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.939054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.949377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 323/630] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.950159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6177-2e10-412b-af68-0d26ba2e7e26 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.950399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.001008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.002316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.003003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.003490 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.005341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:43.005808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.008183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.021484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.031614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 308/631] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:43.031614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.085918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8115e-5a23-49d3-9871-7dfa9c98a2b3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.101348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.135040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae6226-7985-46de-8437-1fdc9e089deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.136182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae6226-7985-46de-8437-1fdc9e089deb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.136589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae6226-7985-46de-8437-1fdc9e089deb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.137220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae6226-7985-46de-8437-1fdc9e089deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.142056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70e084-bc78-4115-b51e-ca9c555e4002 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.183849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.184812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.185226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.185609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.198648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.200251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.217231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae6226-7985-46de-8437-1fdc9e089deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:43.218700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:43.219750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:43.220898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:43.220898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:43.220898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.220898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:43.221178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae6226-7985-46de-8437-1fdc9e089deb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.221265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 309/632] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:43.221265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.279818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.330812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946d4a-acc1-4ece-8129-f804d5a0ef8e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.343865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 324/633] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:43.345525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db7ed-bfa1-4685-adc7-7bc0bfb79e9f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.345856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db7ed-bfa1-4685-adc7-7bc0bfb79e9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.346126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db7ed-bfa1-4685-adc7-7bc0bfb79e9f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.351703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 325/634] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:43.351703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613db7ed-bfa1-4685-adc7-7bc0bfb79e9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.362367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.373608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.374500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.374888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.375144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/65e73243951044e4b5beb3de4ebb0a8f/roles/4dcc6b65bf2143728b2d8ba9b04eadb7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.390908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=65e73243951044e4b5beb3de4ebb0a8f, role_id=4dcc6b65bf2143728b2d8ba9b04eadb7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.392362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.416864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 310/635] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:43 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/65e73243951044e4b5beb3de4ebb0a8f/roles/4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:43.416864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.477056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613db7ed-bfa1-4685-adc7-7bc0bfb79e9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.525116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c1f0d-11bf-4487-b58d-9796baba165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.525939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1f0d-11bf-4487-b58d-9796baba165d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.526304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1f0d-11bf-4487-b58d-9796baba165d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.526668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1f0d-11bf-4487-b58d-9796baba165d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.528721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c1f0d-11bf-4487-b58d-9796baba165d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:43.529152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c1f0d-11bf-4487-b58d-9796baba165d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.531166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c1f0d-11bf-4487-b58d-9796baba165d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.550197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 326/636] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:43.553231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a802-c5ce-4ab2-a08e-f246c3771101 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.553532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a802-c5ce-4ab2-a08e-f246c3771101 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.553822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a802-c5ce-4ab2-a08e-f246c3771101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.555309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29275-ada8-44a7-b872-641ac1fcefcb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.557345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.579612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b568a802-c5ce-4ab2-a08e-f246c3771101 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:43.581639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b568a802-c5ce-4ab2-a08e-f246c3771101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:43.609640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.610660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.610954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.611236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.624122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.626597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:43.650784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:43.651975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:43.653110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:43.653110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:43.653110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.653110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:43.653110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 311/637] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:43.657382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.671011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.676514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 327/638] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:43.677978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568a802-c5ce-4ab2-a08e-f246c3771101 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.766729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c22e58-ac75-4a40-a231-83c59057de88 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.791450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568a802-c5ce-4ab2-a08e-f246c3771101 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.804595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.805654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.806090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.806525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.814682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.818148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.831876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.832547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.833471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.833756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.834500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:43.834815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:43.836184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:43.837205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:43.838163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:43.838714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.840145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 312/639] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:43.841146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.855593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 328/640] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:43.856620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.859306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.927273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.950140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1502904-cf14-4e87-892a-afb65373ac89 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.975274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adc810-2967-493f-ab5b-a59bb66f6d1e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.987859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.988922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.989542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.989975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.001073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:44.009440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9811a5-0119-4af7-9b7a-5221242a2f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:44.009879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.011067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:44.012140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:44.012966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9811a5-0119-4af7-9b7a-5221242a2f4b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.012966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9811a5-0119-4af7-9b7a-5221242a2f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.012966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9811a5-0119-4af7-9b7a-5221242a2f4b None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.012966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9811a5-0119-4af7-9b7a-5221242a2f4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.012966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9811a5-0119-4af7-9b7a-5221242a2f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.013369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9811a5-0119-4af7-9b7a-5221242a2f4b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.015014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 313/641] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.015945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.041002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 329/642] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.042467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1540-03c0-4f3c-82f9-1959415a085b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.042795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1540-03c0-4f3c-82f9-1959415a085b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.043171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1540-03c0-4f3c-82f9-1959415a085b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.048662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 330/643] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:44.049523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1540-03c0-4f3c-82f9-1959415a085b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.099907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.131198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e105d4-802b-45a3-9863-7875a84a0bd0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.160414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1540-03c0-4f3c-82f9-1959415a085b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.165746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.166605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.166955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.167297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.174291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.175817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.180501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:44.191169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.192341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:44.193759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:44.198993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 314/644] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.198993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.206081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f636d2a-b720-4ab8-9d66-5ea272919b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.206830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f636d2a-b720-4ab8-9d66-5ea272919b11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.207188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f636d2a-b720-4ab8-9d66-5ea272919b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.207547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f636d2a-b720-4ab8-9d66-5ea272919b11 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.208514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f636d2a-b720-4ab8-9d66-5ea272919b11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.208924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f636d2a-b720-4ab8-9d66-5ea272919b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.210379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f636d2a-b720-4ab8-9d66-5ea272919b11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.224549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 331/645] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.224549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa4888-6c90-4ebd-9d48-663f42ad3d47 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.224549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa4888-6c90-4ebd-9d48-663f42ad3d47 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.224549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa4888-6c90-4ebd-9d48-663f42ad3d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.239781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d8aa4888-6c90-4ebd-9d48-663f42ad3d47 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:44.245466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8aa4888-6c90-4ebd-9d48-663f42ad3d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:44.320190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec470317-0d27-43f5-b6a4-343549be7634 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.321367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 332/646] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:44.333734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa4888-6c90-4ebd-9d48-663f42ad3d47 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.357990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.358577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.358862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.359136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.361902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.432442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.434157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.452300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa4888-6c90-4ebd-9d48-663f42ad3d47 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.462945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.487737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.488394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.488678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.489637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.490433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.490740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.492177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.509696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 333/647] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.509696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.551576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 315/648] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:44.551576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.584790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.621739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4fb4b-af4a-4943-a944-2e65493e8fd6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.660193 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae35d8-eeee-4239-9f3a-6e250c73c98e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.661382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.662195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.662486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.662772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.674368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.675829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:44.694234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.695412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.696708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:44.696708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:44.696708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:44.696708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:44.696708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 334/649] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.700620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.709272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.710463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.710823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.711106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.722566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:44.725557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:44.731597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.732554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:44.733663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 316/650] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.738013 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.810501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878de12-6a47-4112-868f-8a11eb76184b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.846587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.848042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.848751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.849112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.849407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.850360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=31fbd8b38e80472e83ee62084cd19d3e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.850680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.852110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.854516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50facf92-dde4-4a4e-ba5b-0ccc80270568 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.858144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 335/651] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/role_assignments?user.id=31fbd8b38e80472e83ee62084cd19d3e&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.858824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.904004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.904810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.905137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.905418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.917926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.919439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:44.939973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.941247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.942953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:44.942953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:44.942953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:44.942953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:44.945299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 317/652] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.946257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.992476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.015593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f1e81-a01a-4fda-a617-d8ac11b0753a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.068958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.069626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.069885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938281-9db8-4d6b-9ec7-4869247fddf0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.069995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.070181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.070913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.071217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.072601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.085803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 336/653] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.086708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.125799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.126991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.127625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.128005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.128765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.129102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.131144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.142388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 318/654] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.143972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.158873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.218669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553682e-c012-49f7-b65b-fd34881d741f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.266240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.266914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.267197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.267477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.268214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.269139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.271380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.282150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207ef0-509b-4a7a-8747-76c8a4ccb79c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.287987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 337/655] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.288845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.299877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.328534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.329804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.330342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.330780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.339648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.341699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:45.360143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:45.361427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:45.362553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:45.365914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 319/656] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:45.367128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.408090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa864-6713-4903-940b-3fb2e20ea7d3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.444006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.447031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.448031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.448603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.449724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.461739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.463671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.482402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159209bd-9541-40ea-9be6-ac95b83fe9bd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:45.484075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:45.485177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:45.486283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:45.486283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:45.486283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:45.486283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:45.488271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 338/657] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:45.490100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.531251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.532078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.532363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.532640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.540923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.542547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.555541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:45.559986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:45.561119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:45.562100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 320/658] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:45.562613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.604841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc498-a4e4-4ff4-ab83-2e170dccef51 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.641427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.642245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.642532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.642810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.643642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.643955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.645539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.667044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 339/659] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.668949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.677073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea58323-cfd5-4885-a106-cab31d981782 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.704768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.713369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920e166-63dc-4436-8663-dbc2b4b17c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.714046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e166-63dc-4436-8663-dbc2b4b17c40 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.714334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e166-63dc-4436-8663-dbc2b4b17c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.714623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e166-63dc-4436-8663-dbc2b4b17c40 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.715355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e166-63dc-4436-8663-dbc2b4b17c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.715669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e166-63dc-4436-8663-dbc2b4b17c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.717120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e166-63dc-4436-8663-dbc2b4b17c40 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.729299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 321/660] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.730598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04428-2be8-497d-b29e-b8325db3f676 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.730885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04428-2be8-497d-b29e-b8325db3f676 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.731166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04428-2be8-497d-b29e-b8325db3f676 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.736305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 322/661] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:45.736305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04428-2be8-497d-b29e-b8325db3f676 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.790685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db8e5-2c6a-47a8-8d91-9d35ee8396ae None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.808924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.828444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.829236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.829516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.829796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.830574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.830883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.833117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.839465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04428-2be8-497d-b29e-b8325db3f676 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.850764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 340/662] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.850764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.880310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.880988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.881274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.881569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.937190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.952158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7cce3-354a-42c5-9294-3466b6157bbd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.953112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.956003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.986856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aab2a-7e6f-4023-8fbd-6f0a1e7e3075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.987657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aab2a-7e6f-4023-8fbd-6f0a1e7e3075 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.987946 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aab2a-7e6f-4023-8fbd-6f0a1e7e3075 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.988230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aab2a-7e6f-4023-8fbd-6f0a1e7e3075 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.996437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aab2a-7e6f-4023-8fbd-6f0a1e7e3075 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.997985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aab2a-7e6f-4023-8fbd-6f0a1e7e3075 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fd8aab2a-7e6f-4023-8fbd-6f0a1e7e3075 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:46.012393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:46.013552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:46.014522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 341/663] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:46.015150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304c2c-8d00-4fa0-9f4d-78c8eb5f3636 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.015150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304c2c-8d00-4fa0-9f4d-78c8eb5f3636 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.015280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d304c2c-8d00-4fa0-9f4d-78c8eb5f3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.033593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8d304c2c-8d00-4fa0-9f4d-78c8eb5f3636 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:46.034683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8d304c2c-8d00-4fa0-9f4d-78c8eb5f3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:46.065973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.076815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 323/664] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:46.077923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.112262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 342/665] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:46.113142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304c2c-8d00-4fa0-9f4d-78c8eb5f3636 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.189678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.203638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691b3a-c8ca-4384-bdd2-d0ede21b13e7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.230567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d304c2c-8d00-4fa0-9f4d-78c8eb5f3636 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.237465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.238124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.238414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.238729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.239566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=061cc3a23d944f18b311eb2aa9a651d9) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:46.239888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.241402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.247694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 324/666] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/role_assignments?user.id=061cc3a23d944f18b311eb2aa9a651d9&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:46.248472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.288320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.290434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.290941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.291428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.292523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:46.293120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.295591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.325936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 343/667] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:46.327848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.366877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.367385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5a60b-16ed-4c31-9770-bfdebbec6ba6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.408785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.409666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.410010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.410287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.425898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.425898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:46.444980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:46.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:46.446814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:46.446814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:46.446814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:46.446814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:46.449101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 325/668] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:46.450116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.460084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.469354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e5c7d-ebc0-498c-a3be-68c1b7c7b35b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.510014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.510812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.511095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.511372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.523690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:46.531570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:46.532575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:46.533465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 344/669] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:46.534175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.581896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684b217-9f7d-4d91-b701-1102d0ff6cfb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.639758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.640488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.640889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.641358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.744529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.747666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.751470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.756506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.818976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731f14-046b-4c0e-81a6-bbcbacc52823 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.874478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.876973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.877942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.880940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.882087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:46.884211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.888030 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.921906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 345/670] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:46.923125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.928303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 326/671] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:46.933666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.088743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228b7eb-c4a7-479e-8d26-79eca866cf30 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.113821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908ca1-cadb-4412-8f40-b259a91392b3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.117666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.124706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.125427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.125716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.125999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.126757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:47.127069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.128454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.138065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 346/672] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:47.138888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.150206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.156635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4ef22-fb1c-4ed1-9859-fbc81d6284c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.157468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ef22-fb1c-4ed1-9859-fbc81d6284c9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.157767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ef22-fb1c-4ed1-9859-fbc81d6284c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.158027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ef22-fb1c-4ed1-9859-fbc81d6284c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.164998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4ef22-fb1c-4ed1-9859-fbc81d6284c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.166468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4ef22-fb1c-4ed1-9859-fbc81d6284c9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-aab4ef22-fb1c-4ed1-9859-fbc81d6284c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:47.184662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:47.185698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:47.187168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 327/673] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:47.187829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea127b4-5a2b-41bb-85dc-babe08fcca80 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.188024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea127b4-5a2b-41bb-85dc-babe08fcca80 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.188309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea127b4-5a2b-41bb-85dc-babe08fcca80 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.192877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 328/674] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:47.192877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea127b4-5a2b-41bb-85dc-babe08fcca80 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.252478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4840626-a4c6-4d80-abda-271b97362bcb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.289037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.289934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.290220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.290499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.301886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.302763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea127b4-5a2b-41bb-85dc-babe08fcca80 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.303464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:47.323542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:47.324464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:47.325456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:47.325456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:47.325456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:47.325456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:47.325456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 347/675] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:47.325738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.343163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f285092-b536-4de9-b078-f4a36150cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.343901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285092-b536-4de9-b078-f4a36150cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.344235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285092-b536-4de9-b078-f4a36150cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.344522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285092-b536-4de9-b078-f4a36150cdb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.355931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f285092-b536-4de9-b078-f4a36150cdb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.357428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f285092-b536-4de9-b078-f4a36150cdb7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3f285092-b536-4de9-b078-f4a36150cdb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:47.376004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:47.376968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:47.377884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:47.377884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:47.377884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:47.377884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:47.377884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 329/676] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:47.378740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27fddb-65fc-4f31-99b0-fc53c5d4d651 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.378740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27fddb-65fc-4f31-99b0-fc53c5d4d651 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.379034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27fddb-65fc-4f31-99b0-fc53c5d4d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.394459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.397523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8d27fddb-65fc-4f31-99b0-fc53c5d4d651 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:47.398807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8d27fddb-65fc-4f31-99b0-fc53c5d4d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:47.411018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.440779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955094f-4b36-4e05-9366-25a0e2f524fe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.472937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 330/677] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:47.472937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27fddb-65fc-4f31-99b0-fc53c5d4d651 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.485633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.486500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.487063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.487493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.488424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:47.489633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.491372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.504406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 348/678] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:47.506083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.593127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27fddb-65fc-4f31-99b0-fc53c5d4d651 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.612751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429187a-2ad1-4de2-9f48-29279a6e3de1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.631061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.631728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.631957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.632074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.632275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.633020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:47.633330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.634704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.646613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 331/679] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:47.647415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.654061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.654992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.655452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.655909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.656844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:47.657156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.658531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.663823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.675121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 349/680] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:47.675747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.769059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a587f7d-2066-43f4-a08f-f601a198e392 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.778406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b05d-996b-4bad-a2a5-eb42c931371e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.804863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.805725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.806019 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.806306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.814192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.814836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.815120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.815399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.816221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=473f1bd4a95f4899a4a9a9927f14738c) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:47.816533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.816631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:47.818190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.833094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 350/681] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/role_assignments?user.id=473f1bd4a95f4899a4a9a9927f14738c&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:47.833306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:47.834351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:47.835246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:47.835905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.835979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 332/682] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:47.835979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.878980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.912328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.943742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec39e-f6bb-4118-bac1-3d21fc354216 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.953522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b524a-22f1-4a21-b3b9-72e2eef39b42 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.991265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.992704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.993901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.994684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.998567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.999738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.000021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.000300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.006206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.008674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.010073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.011708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:48.026315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:48.027451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 351/683] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:48.028595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:48.030344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:48.031488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:48.032625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:48.039580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 333/684] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:48.040738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.156781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5490827-34e9-491b-9952-1643685c2c90 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.158307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.168205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcf538-0f1a-47ae-9e95-146513c1d6d7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.198131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.202149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.203144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.203944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.204452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.205679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:48.206174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.208513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.209640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.210474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.210726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.211075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.212144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:48.212256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.213771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.220061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 352/685] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:48.221227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.237044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 334/686] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:48.237945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.345164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dab547-d036-40cb-bbe4-197cbbdd4d81 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.357125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66558-df5a-4403-b5b1-35ad35fe0bd9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.385990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.386850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.387225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.387570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.399501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.401180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.404657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.405580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.406069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.406533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.407616 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:48.408111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.409847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:48.421863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:48.422800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:48.424038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:48.424038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:48.424038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:48.424038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:48.428008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 335/687] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:48.429498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.434570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 353/688] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:48.435689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.469412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.473901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.547838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfcad0-672d-4d64-91be-d3d1f18ba391 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.550462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836266a-19f7-4ce3-97f8-06a8dc96622d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.585288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.585974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.586225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.586504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.587075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a61201-276a-41a7-a648-f2d374293618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.587327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=7456efd79db1474fa9f0b392d9c7e4ce) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:48.587641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.587736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a61201-276a-41a7-a648-f2d374293618 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.588000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a61201-276a-41a7-a648-f2d374293618 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.588275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a61201-276a-41a7-a648-f2d374293618 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.589035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a61201-276a-41a7-a648-f2d374293618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:48.589132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.589340 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a61201-276a-41a7-a648-f2d374293618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.590689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a61201-276a-41a7-a648-f2d374293618 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.603910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 336/689] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/role_assignments?user.id=7456efd79db1474fa9f0b392d9c7e4ce&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:48.603910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.607501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 354/690] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:48.609053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86981e91-3913-4875-be50-f0f1d3781eae None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.609344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86981e91-3913-4875-be50-f0f1d3781eae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.609741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86981e91-3913-4875-be50-f0f1d3781eae None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.611541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 355/691] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:48.612341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86981e91-3913-4875-be50-f0f1d3781eae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.732496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.748072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5454617-1c4b-4aba-adc9-b15c562fd2a1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.750563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.758142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86981e91-3913-4875-be50-f0f1d3781eae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.798243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.798903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.799192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.799474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.801135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9c581-d21f-46c7-a517-9ac7f2e2b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.803620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9c581-d21f-46c7-a517-9ac7f2e2b483 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.804014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9c581-d21f-46c7-a517-9ac7f2e2b483 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.804384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9c581-d21f-46c7-a517-9ac7f2e2b483 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.813430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9c581-d21f-46c7-a517-9ac7f2e2b483 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.814900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9c581-d21f-46c7-a517-9ac7f2e2b483 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-44e9c581-d21f-46c7-a517-9ac7f2e2b483 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:48.832652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:48.833814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 356/692] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699d88-ad8d-4a0f-906d-610a5cd08707 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.835541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699d88-ad8d-4a0f-906d-610a5cd08707 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.836265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699d88-ad8d-4a0f-906d-610a5cd08707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.857265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d4699d88-ad8d-4a0f-906d-610a5cd08707 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:48.859211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4699d88-ad8d-4a0f-906d-610a5cd08707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:48.893545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.895285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.947729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 357/693] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:48.948913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699d88-ad8d-4a0f-906d-610a5cd08707 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.023483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 337/694] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:49.024420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.026867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.045221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.068289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699d88-ad8d-4a0f-906d-610a5cd08707 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.105699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.106625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.107054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.107616 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.108610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.109096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.110940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.130966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 358/695] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:49.132121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.138932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d6e4b-108a-4bec-a273-ca01c82b5caa None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.179861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.181436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.181903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.182287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.196796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.199335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:49.224223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:49.225383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:49.226487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:49.226487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:49.226487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:49.226487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:49.228356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 338/696] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:49.229738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.245898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04e0c3-be54-4566-84d9-31c5e9b1e35d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.282197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.283239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.283667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.284087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.294607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.296268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.297174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.307042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:49.317802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:49.318963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:49.320056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:49.320056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:49.320056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:49.320056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:49.322159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 359/697] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:49.323252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.365954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c639-74cb-4bce-93c8-6c714dd2e779 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.401842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.403091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.403375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.403653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.467398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0832ba-8ad0-42bf-b3f6-1d749839edbc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.477410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.479009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.516218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.517185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.517622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.518050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.518923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.519380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.522069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.535250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 360/698] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:49.536930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.542042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.591720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 339/699] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:49.592746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.595827 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.673810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf5e9-dcc2-4000-9982-3394bc735f3c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.716018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587459d-e759-4b4f-8e6a-1f9938d1117d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.719849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.720468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.720753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.721056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.721792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.722104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.724101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.740638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 361/700] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:49.741730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.755905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.756939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.757447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.757920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.758818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.760616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.785368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 340/701] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:49 2022] POST /identity/v3/users => generated 254 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:49.787243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.817859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.897201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9245359-7672-4cd0-81ee-f02201e65223 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.899511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.939951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.941170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.941671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.942190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.954248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.956050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:49.976877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:49.977845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:49.978755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:49.978755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:49.978755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:49.978755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:49.981226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 362/702] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:49.988438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.002408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c98921-b4a7-46f9-bf1b-e4b8d067430a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.050666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65562c6c-2110-4729-b06a-6a8bc85ce908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.051781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562c6c-2110-4729-b06a-6a8bc85ce908 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.052159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562c6c-2110-4729-b06a-6a8bc85ce908 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.052509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562c6c-2110-4729-b06a-6a8bc85ce908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.062257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65562c6c-2110-4729-b06a-6a8bc85ce908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.063763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65562c6c-2110-4729-b06a-6a8bc85ce908 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-65562c6c-2110-4729-b06a-6a8bc85ce908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:50.080964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:50.082037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:50.083376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 341/703] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:50.084212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4fafb-2787-49cb-8f1b-6c77777eda17 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.084508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4fafb-2787-49cb-8f1b-6c77777eda17 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.084789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4fafb-2787-49cb-8f1b-6c77777eda17 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.086317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 342/704] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:50.091200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4fafb-2787-49cb-8f1b-6c77777eda17 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.131043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c47aa-2fd7-4c1a-b363-57f5e6326bcf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.169493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ed815-edab-4f48-ba98-e5919ef29872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.170155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ed815-edab-4f48-ba98-e5919ef29872 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.170438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ed815-edab-4f48-ba98-e5919ef29872 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.170714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ed815-edab-4f48-ba98-e5919ef29872 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.171435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ed815-edab-4f48-ba98-e5919ef29872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.171735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ed815-edab-4f48-ba98-e5919ef29872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.173124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ed815-edab-4f48-ba98-e5919ef29872 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.184704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.190468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 363/705] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.191871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622785ef-c379-4949-af53-70607d43ebb2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.192351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622785ef-c379-4949-af53-70607d43ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.192879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622785ef-c379-4949-af53-70607d43ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.211959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-622785ef-c379-4949-af53-70607d43ebb2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:50.213642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-622785ef-c379-4949-af53-70607d43ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:50.225522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4fafb-2787-49cb-8f1b-6c77777eda17 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.226561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.265020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.265947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.266389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.266822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.267748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.268205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.270406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.285101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 343/706] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.287056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.320863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 364/707] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:50.320863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622785ef-c379-4949-af53-70607d43ebb2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.425222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e9d6-0ae3-419f-b97e-4823ee325a0f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.450076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622785ef-c379-4949-af53-70607d43ebb2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.457706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.469825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.471309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.471602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.471886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.482395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.485010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.494985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.495950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.496458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.496960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.498044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=65e73243951044e4b5beb3de4ebb0a8f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.498557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.500189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:50.501589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:50.502492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:50.503459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:50.509170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 344/708] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:50.510161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.521099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 365/709] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/role_assignments?user.id=65e73243951044e4b5beb3de4ebb0a8f&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.522405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.544109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.638289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001a9e-aa01-45a5-91ba-2b5b412a0ec4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.682433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.683984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.684272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.684557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.685265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.686836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:50.704164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:50.705247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:50.706132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 345/710] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:50.716994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.773442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42f927-3455-432e-a3c8-49400ba98044 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.803948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.819542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7d2f-eb12-4902-8166-87dee7269e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.820560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7d2f-eb12-4902-8166-87dee7269e65 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.821115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7d2f-eb12-4902-8166-87dee7269e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.821603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7d2f-eb12-4902-8166-87dee7269e65 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.822750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7d2f-eb12-4902-8166-87dee7269e65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.823322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7d2f-eb12-4902-8166-87dee7269e65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.825022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7d2f-eb12-4902-8166-87dee7269e65 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.840031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 366/711] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.845480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342d0ad-5390-4d20-b07e-3249b6896995 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.845480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342d0ad-5390-4d20-b07e-3249b6896995 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.845480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342d0ad-5390-4d20-b07e-3249b6896995 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.846344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 367/712] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:50.847068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342d0ad-5390-4d20-b07e-3249b6896995 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.856353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3448b7-4392-4b20-b422-2216acab5de8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.905470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851172a-762d-4376-9350-b7c1e219384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.906451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851172a-762d-4376-9350-b7c1e219384a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.906946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851172a-762d-4376-9350-b7c1e219384a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.907480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851172a-762d-4376-9350-b7c1e219384a None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.908396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851172a-762d-4376-9350-b7c1e219384a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.908948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851172a-762d-4376-9350-b7c1e219384a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.910661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851172a-762d-4376-9350-b7c1e219384a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.915878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 346/713] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.917229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113caae8-bc07-4303-8bea-86a35c6ae82e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.917635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113caae8-bc07-4303-8bea-86a35c6ae82e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.917995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113caae8-bc07-4303-8bea-86a35c6ae82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.936653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-113caae8-bc07-4303-8bea-86a35c6ae82e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:50.938160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-113caae8-bc07-4303-8bea-86a35c6ae82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:50.940298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.979434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342d0ad-5390-4d20-b07e-3249b6896995 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:51.028943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 347/714] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:51.028943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113caae8-bc07-4303-8bea-86a35c6ae82e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:51.032375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:51.033077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.033358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.033642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.034476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=31fbd8b38e80472e83ee62084cd19d3e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:51.034797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:51.042862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:51.052488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 368/715] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/role_assignments?user.id=31fbd8b38e80472e83ee62084cd19d3e&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:51.057509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:51.141196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:51.239753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113caae8-bc07-4303-8bea-86a35c6ae82e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:51.257574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda1f81-ba00-42b4-ba96-b9bf53fdbe77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:51.294730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:51.295750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.296425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.296893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.297816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:51.299552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:51.300070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:51.302832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:51.304613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:51.305561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.305957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.306333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.307570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:51.309128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:51.311009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 348/716] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:51.331961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:51.333842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:51.334876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:51.337468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 369/717] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:51 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:51.343404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:51.465809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c278-3660-42cb-8fa9-b731d945aed6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:51.481502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:51.505972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4185a1-95dd-47fc-8c12-64fe02fbd5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:51.507064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4185a1-95dd-47fc-8c12-64fe02fbd5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.508142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4185a1-95dd-47fc-8c12-64fe02fbd5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.508580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4185a1-95dd-47fc-8c12-64fe02fbd5f7 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.509476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4185a1-95dd-47fc-8c12-64fe02fbd5f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:51.509931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4185a1-95dd-47fc-8c12-64fe02fbd5f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:51.511457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4185a1-95dd-47fc-8c12-64fe02fbd5f7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:51.516609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 349/718] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:51.522276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:51.651033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bff57-dea2-4ce8-a2bd-bdd5eb34430f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:51.702675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515c50-199c-4587-a82c-39a81cab2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:51.703348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515c50-199c-4587-a82c-39a81cab2862 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.703637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515c50-199c-4587-a82c-39a81cab2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.703921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515c50-199c-4587-a82c-39a81cab2862 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.704637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515c50-199c-4587-a82c-39a81cab2862 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:51.704977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515c50-199c-4587-a82c-39a81cab2862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:51.706383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515c50-199c-4587-a82c-39a81cab2862 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:51.717840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 370/719] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:52.257672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84bb40-8dd6-4805-8220-d0512a7ef25a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.258201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84bb40-8dd6-4805-8220-d0512a7ef25a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.258287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84bb40-8dd6-4805-8220-d0512a7ef25a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.259908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 350/720] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:52.264984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e568c1-52bb-4901-be79-60685f5d4c36 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.265406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e568c1-52bb-4901-be79-60685f5d4c36 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.265553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e568c1-52bb-4901-be79-60685f5d4c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.287660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-18e568c1-52bb-4901-be79-60685f5d4c36 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:52.288881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-18e568c1-52bb-4901-be79-60685f5d4c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:52.374472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.388073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 371/721] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:52.422715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84bb40-8dd6-4805-8220-d0512a7ef25a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.549321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84bb40-8dd6-4805-8220-d0512a7ef25a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.594643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.595456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.595745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.596027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.614690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:52.622798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:52.623743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:52.624590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 351/722] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:52.631874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e568c1-52bb-4901-be79-60685f5d4c36 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.739513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e568c1-52bb-4901-be79-60685f5d4c36 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.780158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71f16a-2fc6-49e9-a90c-48808d0ca457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.781144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f16a-2fc6-49e9-a90c-48808d0ca457 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.781572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f16a-2fc6-49e9-a90c-48808d0ca457 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.781993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f16a-2fc6-49e9-a90c-48808d0ca457 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.782895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f16a-2fc6-49e9-a90c-48808d0ca457 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:52.783357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f16a-2fc6-49e9-a90c-48808d0ca457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:52.784897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f16a-2fc6-49e9-a90c-48808d0ca457 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:52.800315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.800895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 372/723] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:52.885944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.991161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caee86-d043-459b-aa98-6d5d0014ecf7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.030667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8560d-5b3b-4f1d-9afb-039e54cfcf62 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.031379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8560d-5b3b-4f1d-9afb-039e54cfcf62 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.031862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8560d-5b3b-4f1d-9afb-039e54cfcf62 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.034854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 373/724] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:53.039877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a058da-8b77-4244-9d1f-836327a3a847 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.040432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a058da-8b77-4244-9d1f-836327a3a847 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.040962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a058da-8b77-4244-9d1f-836327a3a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.045479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.046883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.048168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.049233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.071201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c0a058da-8b77-4244-9d1f-836327a3a847 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:53.072849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.074544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.075970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c0a058da-8b77-4244-9d1f-836327a3a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:53.106868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:53.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:53.108851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:53.108851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:53.108851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:53.108851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:53.113423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 352/725] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:53.118327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.169498 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.208758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 374/726] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:53.262308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.279982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a058da-8b77-4244-9d1f-836327a3a847 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.284379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9a16a-9289-45f6-9197-70b3267e6f88 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.326038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.327180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.328510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.331591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.333456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:53.334201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.336843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.363272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 353/727] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:53.374945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.505198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73880c97-cc2c-43e2-8b87-84485bba2b3c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.508639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a058da-8b77-4244-9d1f-836327a3a847 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.550543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.551414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.551414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.552050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.565374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.566936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.581163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.581903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.582761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.583217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:53.596970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:53.598585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:53.600863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 354/728] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:53.605998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.606908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:53.622930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:53.625615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:53.627958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 375/729] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:53.631248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.637991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.710084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.773298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7854c6-cdf1-4c42-a07f-0740f76fe0bb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.774271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd96bb-9cff-4232-8f2f-430ab20b15ff None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.808990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dc355-a7f1-4da9-927d-dc954fc5e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.809822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dc355-a7f1-4da9-927d-dc954fc5e5ff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.810218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dc355-a7f1-4da9-927d-dc954fc5e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.810578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dc355-a7f1-4da9-927d-dc954fc5e5ff None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.811408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dc355-a7f1-4da9-927d-dc954fc5e5ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:53.811793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dc355-a7f1-4da9-927d-dc954fc5e5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.813296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dc355-a7f1-4da9-927d-dc954fc5e5ff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.819742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093abc6-f5c5-4870-b3f8-e1554b888185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.820522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093abc6-f5c5-4870-b3f8-e1554b888185 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.821203 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093abc6-f5c5-4870-b3f8-e1554b888185 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.821562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093abc6-f5c5-4870-b3f8-e1554b888185 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.822692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093abc6-f5c5-4870-b3f8-e1554b888185 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:53.823810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 376/730] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:53.823973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093abc6-f5c5-4870-b3f8-e1554b888185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.825858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093abc6-f5c5-4870-b3f8-e1554b888185 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.827664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416fc5-5239-4b1c-8eb5-382cd72c8350 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.829084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416fc5-5239-4b1c-8eb5-382cd72c8350 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.829084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416fc5-5239-4b1c-8eb5-382cd72c8350 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.829650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 377/731] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:53.832932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416fc5-5239-4b1c-8eb5-382cd72c8350 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.854754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 355/732] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:53.856185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da56c0-7c6e-454a-a135-37f302270071 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.856550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da56c0-7c6e-454a-a135-37f302270071 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.856941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da56c0-7c6e-454a-a135-37f302270071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.880443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-71da56c0-7c6e-454a-a135-37f302270071 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:53.882314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-71da56c0-7c6e-454a-a135-37f302270071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:53.947080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416fc5-5239-4b1c-8eb5-382cd72c8350 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.949928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.962699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.977086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 356/733] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:53.978086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da56c0-7c6e-454a-a135-37f302270071 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.988974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.990860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.991715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.992222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.005543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.007345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:54.026477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.027573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.028503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:54.028503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:54.028503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.028503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:54.029066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 378/734] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:54.029733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.103754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da56c0-7c6e-454a-a135-37f302270071 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.141099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.141758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.142159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.142438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.145065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d2260-2899-405a-9883-5efa992f5566 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.181281 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cecf7-2eaa-44ad-8b03-2c11b72b00fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.182095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cecf7-2eaa-44ad-8b03-2c11b72b00fc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.182386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cecf7-2eaa-44ad-8b03-2c11b72b00fc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.182671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cecf7-2eaa-44ad-8b03-2c11b72b00fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.193708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cecf7-2eaa-44ad-8b03-2c11b72b00fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-664cecf7-2eaa-44ad-8b03-2c11b72b00fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:54.201439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.202462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:54.203323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 379/735] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:54.204911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4fc7-24fe-4351-90be-3c2abfe61105 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.204911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4fc7-24fe-4351-90be-3c2abfe61105 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.205091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4fc7-24fe-4351-90be-3c2abfe61105 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.208868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 380/736] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:54.208868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4fc7-24fe-4351-90be-3c2abfe61105 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.220684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.229865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.230130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.231813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.323652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4fc7-24fe-4351-90be-3c2abfe61105 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.343980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 357/737] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:54.344847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.366010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320d16-5ccc-4dd3-b930-6deb35fdc2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.366632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320d16-5ccc-4dd3-b930-6deb35fdc2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.366922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320d16-5ccc-4dd3-b930-6deb35fdc2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.367345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320d16-5ccc-4dd3-b930-6deb35fdc2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.368184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320d16-5ccc-4dd3-b930-6deb35fdc2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:54.368499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320d16-5ccc-4dd3-b930-6deb35fdc2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.369912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320d16-5ccc-4dd3-b930-6deb35fdc2f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.383937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 381/738] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:54.384638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846136dd-a1e8-4bf5-a9a4-4c57ecf874d6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.384964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846136dd-a1e8-4bf5-a9a4-4c57ecf874d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.385253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846136dd-a1e8-4bf5-a9a4-4c57ecf874d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.401355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-846136dd-a1e8-4bf5-a9a4-4c57ecf874d6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:54.402563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-846136dd-a1e8-4bf5-a9a4-4c57ecf874d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:54.443881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.450700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1405cc-55be-4a6a-9fe6-09e462639f76 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.469511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 382/739] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:54.470157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846136dd-a1e8-4bf5-a9a4-4c57ecf874d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.485434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575019-1efb-477c-8705-aba4165a90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.486135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575019-1efb-477c-8705-aba4165a90eb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.486428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575019-1efb-477c-8705-aba4165a90eb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.486713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575019-1efb-477c-8705-aba4165a90eb None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.487458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575019-1efb-477c-8705-aba4165a90eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:54.487774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575019-1efb-477c-8705-aba4165a90eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.489817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.489933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575019-1efb-477c-8705-aba4165a90eb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.499114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 358/740] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:54.500240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1316-09a5-4b03-9c92-a4ef3681e911 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.500536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1316-09a5-4b03-9c92-a4ef3681e911 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.500847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1316-09a5-4b03-9c92-a4ef3681e911 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.502327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 359/741] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:54.503040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1316-09a5-4b03-9c92-a4ef3681e911 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.586181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846136dd-a1e8-4bf5-a9a4-4c57ecf874d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.605260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1316-09a5-4b03-9c92-a4ef3681e911 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.620126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.620869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.621159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.621438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.631395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.632874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.639077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4916-5325-44d3-8423-49264ebc9c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.639863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4916-5325-44d3-8423-49264ebc9c29 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.640145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4916-5325-44d3-8423-49264ebc9c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.640440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4916-5325-44d3-8423-49264ebc9c29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.647353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee4916-5325-44d3-8423-49264ebc9c29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.648774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee4916-5325-44d3-8423-49264ebc9c29 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:54.650200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.651117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.652020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:54.652020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:54.652020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.652020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:54.652020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 383/742] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:54.652313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-75ee4916-5325-44d3-8423-49264ebc9c29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:54.666904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.668075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:54.669086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 360/743] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:54.669722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23884-1344-4ccc-b103-8d697825b7f7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.670018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23884-1344-4ccc-b103-8d697825b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.670301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23884-1344-4ccc-b103-8d697825b7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.686864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b5d23884-1344-4ccc-b103-8d697825b7f7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:54.688045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b5d23884-1344-4ccc-b103-8d697825b7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:54.701022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.719639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.755247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 361/744] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:54.756263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23884-1344-4ccc-b103-8d697825b7f7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.771389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65efb38-e342-4c0d-be96-a48e679e2b06 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.806456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.807118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.807403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.807682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.808411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.809815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.824113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 384/745] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:05:54 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:54.824949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.875435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23884-1344-4ccc-b103-8d697825b7f7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.925549 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.926830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.927117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.927400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.939281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.940780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.941977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02027cbc-73de-480a-96f1-8fe66ca89801 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.943697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:54.963238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.964261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.965805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:54.965805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:54.965805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.965805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:54.967220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.969402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 362/746] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:54.970577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.985944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.986553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.987902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.987902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.987902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:54.988171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.990637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.004611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 385/747] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.005639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.082014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc7679-88ea-4838-a3a4-102f6beb3ced None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.117200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2923128-552a-4c6e-853e-7f973494490f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.117390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.118225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.118508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.118785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.119611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.119920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.121391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.140007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 363/748] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.140747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.160023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.160708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.161384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.161384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.162020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.163413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.184857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 386/749] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:05:55 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:55.184857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.235747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.336090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc09c-5cd7-4699-ac0c-3b18170a1e62 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.348267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.388168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.389503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.389503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.389722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.401865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e372-7481-4e0b-9feb-c365faacf3f4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.402220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.403733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:55.418919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:55.420043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:55.421306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:55.423429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 387/750] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:55.425381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.448061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.448974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.449352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.449748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.450570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.450978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.452543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.466461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 364/751] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.467635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.545148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.553688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbcc7-a3d2-4cfc-b9c6-b49205189d04 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.590910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708ab2-316d-4694-a368-aca28aa667d7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.591155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.591822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.592112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.592405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.611498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.645235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.646284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.646667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.647539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.648703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.649146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.658238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.671861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.673388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.682808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 365/752] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.684361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.786169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.796335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 388/753] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:05:55.797542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.812554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff30e-db7b-4c1e-a6c1-16a60bccdab9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.856090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.857198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.857488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.857771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.868537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.870226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:55.888866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:55.889884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:55.890850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 366/754] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:55.895845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.907347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7ae19-691d-4507-b7d0-fb9542454d1e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.934567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.951391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.952311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.952604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.952990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.954004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=ae32108815704de987d20434ea951c43) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.954335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.956119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.964910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 389/755] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/role_assignments?user.id=ae32108815704de987d20434ea951c43&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.966081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.065416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc9088-5c76-45f6-8a1f-41f93d4dfa56 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.103408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:56.145772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.146973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.147483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.147986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.168465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.170133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.185575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144b78a-b5bd-49d8-91f2-a56651c3fa44 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:56.192311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:56.193282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:56.194202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:56.194202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:56.194202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:56.194202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:56.196931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 367/756] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:56.199358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.256657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.257360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.257647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.257927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.258768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:56.259077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.260527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.301174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 390/757] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:56.311321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.351949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:56.378411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710822e-2b60-4425-996c-8ae9a14f40ad None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.452538 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.453148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.453433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.453712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.454443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:56.454751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.458159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.474865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f82a3-2824-4790-9fdd-5987b1ffd745 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.487414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 368/758] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:56.492062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.513121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:56.535094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.536271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.536557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.536851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.550493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.552637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:56.574326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:56.575300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:56.576227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:56.576227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:56.576227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:56.576227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:56.576913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 391/759] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:56.583577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.691246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025afe5-1753-4409-8cfd-44c93dc22981 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.744450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982bb2-0bfc-4271-a9cd-56698b2d9513 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.754462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.755395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.755686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.755965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.775984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.777494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.807951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.808618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.808930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.809216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.809950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:56.810263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.811644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:56.818219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:56.819122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:56.820026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 369/760] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:56.826189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.840611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 392/761] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:56.840916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:56.849038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.904494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:56.992697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c91d6e-bb6b-4422-a192-c09884aac38d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.029516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ac450-0286-4a7a-8b75-f27eccbd7cdd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.054829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b4bd2-96dd-4b9e-98a5-71e54d48612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.055778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4bd2-96dd-4b9e-98a5-71e54d48612d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.056066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4bd2-96dd-4b9e-98a5-71e54d48612d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.056348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4bd2-96dd-4b9e-98a5-71e54d48612d None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.057852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b4bd2-96dd-4b9e-98a5-71e54d48612d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:57.058173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b4bd2-96dd-4b9e-98a5-71e54d48612d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.060170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b4bd2-96dd-4b9e-98a5-71e54d48612d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.068986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d9ecf-eeeb-4963-a068-d4f65f76603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.069890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d9ecf-eeeb-4963-a068-d4f65f76603b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.070248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d9ecf-eeeb-4963-a068-d4f65f76603b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.070603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d9ecf-eeeb-4963-a068-d4f65f76603b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.076984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 370/762] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:57.078619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47594f-7f6c-4447-a251-6779a8907602 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.078918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47594f-7f6c-4447-a251-6779a8907602 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.079206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47594f-7f6c-4447-a251-6779a8907602 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.080713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 371/763] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:57.081507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d9ecf-eeeb-4963-a068-d4f65f76603b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.083251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d9ecf-eeeb-4963-a068-d4f65f76603b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.084374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47594f-7f6c-4447-a251-6779a8907602 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-582d9ecf-eeeb-4963-a068-d4f65f76603b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:57.104913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:57.105887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:57.106805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:57.107245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 393/764] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:57.108849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854eac-c6c1-4be3-877d-bb3ed91d0e46 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.108849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854eac-c6c1-4be3-877d-bb3ed91d0e46 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.109184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854eac-c6c1-4be3-877d-bb3ed91d0e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.132084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a9854eac-c6c1-4be3-877d-bb3ed91d0e46 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:57.134113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a9854eac-c6c1-4be3-877d-bb3ed91d0e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:57.181341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.212630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 394/765] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:57.214406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9854eac-c6c1-4be3-877d-bb3ed91d0e46 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.245562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.254001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47594f-7f6c-4447-a251-6779a8907602 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.301974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.302749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.303034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.303312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.304146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=65e73243951044e4b5beb3de4ebb0a8f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:57.304456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.305953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.312520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 372/766] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/role_assignments?user.id=65e73243951044e4b5beb3de4ebb0a8f&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:57.313404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.359208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9854eac-c6c1-4be3-877d-bb3ed91d0e46 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.409961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.412516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.413181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.415183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.416274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:57.418605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.420353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.456091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 395/767] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:57.460291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.519666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6103-5999-485c-b6ce-1b7593677fd3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.554875 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.570208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1dcd5-06e5-43b0-bbe7-004b9ab7069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.571029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1dcd5-06e5-43b0-bbe7-004b9ab7069c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.571313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1dcd5-06e5-43b0-bbe7-004b9ab7069c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.571591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1dcd5-06e5-43b0-bbe7-004b9ab7069c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.572382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1dcd5-06e5-43b0-bbe7-004b9ab7069c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.573826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1dcd5-06e5-43b0-bbe7-004b9ab7069c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cfe1dcd5-06e5-43b0-bbe7-004b9ab7069c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:57.590968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:57.591938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:57.592796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 373/768] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:57.594212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a56d3-6dd1-4d3c-9947-4d3a545459b8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.594212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a56d3-6dd1-4d3c-9947-4d3a545459b8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.594377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a56d3-6dd1-4d3c-9947-4d3a545459b8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.599778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 374/769] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:57.601066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a56d3-6dd1-4d3c-9947-4d3a545459b8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.603181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.628056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a1767-e0b9-4d33-bec2-2e248e6e2065 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.668130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f520a63-798b-4eb7-bb14-a331517a9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.671223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a63-798b-4eb7-bb14-a331517a9a9b None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.671974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a63-798b-4eb7-bb14-a331517a9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.672774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a63-798b-4eb7-bb14-a331517a9a9b None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/31fbd8b38e80472e83ee62084cd19d3e/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.676401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f520a63-798b-4eb7-bb14-a331517a9a9b None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=31fbd8b38e80472e83ee62084cd19d3e, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.678169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f520a63-798b-4eb7-bb14-a331517a9a9b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.700938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 396/770] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:57 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/31fbd8b38e80472e83ee62084cd19d3e/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:57.700938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe431b-dbfe-4547-9d61-278e45d6e953 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.700938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe431b-dbfe-4547-9d61-278e45d6e953 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.700938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe431b-dbfe-4547-9d61-278e45d6e953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.734187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4bfe431b-dbfe-4547-9d61-278e45d6e953 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:57.735653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bfe431b-dbfe-4547-9d61-278e45d6e953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:57.753282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a56d3-6dd1-4d3c-9947-4d3a545459b8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.825835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.826483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.826772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.827052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.827826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:57.828137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.831030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.842692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 375/771] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:57.849416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.893772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 397/772] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:57.920336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe431b-dbfe-4547-9d61-278e45d6e953 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.930227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.994361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439de7c-5103-4c0c-8491-0af993a1a201 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.018094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.051922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.053685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.054126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.054580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.056104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.056569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.058677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.062980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe431b-dbfe-4547-9d61-278e45d6e953 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.067198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 376/773] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.072095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.130749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.131790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.132778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.133402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.135069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.137928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:58.160352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:58.161661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:58.162727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:05:58.165617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 398/774] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:58.174952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.247816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a8901-bd35-4451-9858-f2677544ab3c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.273393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.286970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.287631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.287925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.288207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.289033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] RBAC: Adding query filter params (interface=public, service_id=77e04c49951647dfb6e4e75b3a27aa3d, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.289353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.290731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.298860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 377/775] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/endpoints?service_id=77e04c49951647dfb6e4e75b3a27aa3d&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.304139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.368688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfdddb-10f7-4aed-97ef-f35c3bc5184b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.402165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.409357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6a0be-13f9-4a42-8809-a89e7681f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.410400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6a0be-13f9-4a42-8809-a89e7681f789 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.410999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6a0be-13f9-4a42-8809-a89e7681f789 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.411499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6a0be-13f9-4a42-8809-a89e7681f789 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.412432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6a0be-13f9-4a42-8809-a89e7681f789 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.412998 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6a0be-13f9-4a42-8809-a89e7681f789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.414796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6a0be-13f9-4a42-8809-a89e7681f789 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.420463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 399/776] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.426347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfb99-1672-4bb3-996b-df70c094a786 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.426521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d50636-61e6-464d-8c6c-ce29a0456213 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.427208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfb99-1672-4bb3-996b-df70c094a786 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.427702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dfb99-1672-4bb3-996b-df70c094a786 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.429548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 400/777] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:58.430481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dfb99-1672-4bb3-996b-df70c094a786 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.463590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ee5f7-f8ce-454f-9866-20f3d0ca1c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.464265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ee5f7-f8ce-454f-9866-20f3d0ca1c9b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.464536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ee5f7-f8ce-454f-9866-20f3d0ca1c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.464812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ee5f7-f8ce-454f-9866-20f3d0ca1c9b None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.465507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ee5f7-f8ce-454f-9866-20f3d0ca1c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.466885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ee5f7-f8ce-454f-9866-20f3d0ca1c9b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.477665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 378/778] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:58.477665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3479-acd7-4790-96e1-0ef2547ebbef None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.477665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3479-acd7-4790-96e1-0ef2547ebbef None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.477665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3479-acd7-4790-96e1-0ef2547ebbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.508702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-70bd3479-acd7-4790-96e1-0ef2547ebbef None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:58.509955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-70bd3479-acd7-4790-96e1-0ef2547ebbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:58.602578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dfb99-1672-4bb3-996b-df70c094a786 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.611802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.645957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.647544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.647985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.648438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.649804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.650290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.652259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.658222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 401/779] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.659264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 379/780] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:58.670133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.695993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3479-acd7-4790-96e1-0ef2547ebbef None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.749821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.808971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2490c-19e5-49d2-a34c-3fbdcbb64512 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.835639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3479-acd7-4790-96e1-0ef2547ebbef None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.846716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.847386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.848295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.848579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.849679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] RBAC: Adding query filter params (interface=public, service_id=9c13c2906c4647b28887fec29e32ed09, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.849862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.851475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.859358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 402/781] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/endpoints?service_id=9c13c2906c4647b28887fec29e32ed09&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.865362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.886666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.888198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.888481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.888759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.909022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:58.922334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:58.923299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:58.924146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 380/782] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:58.930091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.984199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.046682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a08cb-44bd-430a-b320-01958c1610cd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.081841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.082583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.082874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.083156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.083909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:59.084218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.085629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.094919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 381/783] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:59.101051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.106437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b300d-6c6f-4d8e-99fd-0870b942174c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.170530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.214429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ca16b-0ae0-418a-b87c-41f2c97e4832 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.217528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.218219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.218511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.218792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.219497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.220921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.222235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.243808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 403/784] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services => generated 772 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:59.251565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.252448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.252743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.253052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.265708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.267261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:59.293381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:59.294363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:59.295254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:59.295254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:59.295254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:59.295254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:59.296149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 382/785] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:59.303163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.485064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd56dc-8149-4df0-84bd-9f4226923275 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.530577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b679ab-6563-446e-9e98-163fbd39fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.531246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b679ab-6563-446e-9e98-163fbd39fd92 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.531534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b679ab-6563-446e-9e98-163fbd39fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.531814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b679ab-6563-446e-9e98-163fbd39fd92 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.532542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b679ab-6563-446e-9e98-163fbd39fd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:59.532867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b679ab-6563-446e-9e98-163fbd39fd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.534249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b679ab-6563-446e-9e98-163fbd39fd92 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.547041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 404/786] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:59.554023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.659325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cc541-e42f-4c40-9b94-85e03b7b589c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.663004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e072-bdc3-4720-b285-c641b8752476 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.663432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e072-bdc3-4720-b285-c641b8752476 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.663607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e072-bdc3-4720-b285-c641b8752476 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.666235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 405/787] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:59.672282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca4591-e8b9-4ff3-ae42-c79e3bcc5000 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.673642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca4591-e8b9-4ff3-ae42-c79e3bcc5000 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.673642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca4591-e8b9-4ff3-ae42-c79e3bcc5000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.696527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-34ca4591-e8b9-4ff3-ae42-c79e3bcc5000 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:59.698018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-34ca4591-e8b9-4ff3-ae42-c79e3bcc5000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:59.698820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.699701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.700052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.700397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.709558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.711100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:59.726900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:59.727881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:59.728839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:05:59.731437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 383/788] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:59.737256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.772030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.773109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.824282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 406/789] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:59.855776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca4591-e8b9-4ff3-ae42-c79e3bcc5000 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.899177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d2a0-c9dd-494e-bd44-e6c1e1677ef3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.940143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.941231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.942605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.943212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.944385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:59.944964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.946690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.967697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 384/790] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:59.975414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.063355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:00.084704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef8591-3913-4fce-9178-6291cfdc30b9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.086776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca4591-e8b9-4ff3-ae42-c79e3bcc5000 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.122129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.123327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.123815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.124294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.135196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:00.137025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:00.155871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:00.156792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:00.157749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:00.157749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:00.157749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:00.157749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:00.160110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 385/791] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:00.172759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.190444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.191246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.191582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.191869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.225707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:00.241586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:00.242542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:00.244085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 407/792] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:00.253868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.279375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880949-5c36-499c-b278-9f788d2eb921 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.304733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:00.316189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.317313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.317809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.318299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.319241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:00.319773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:00.321394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:00.334745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 386/793] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:00.342344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.351084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:00.418410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5ed87-f0cd-402f-be71-bb4fb9370195 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.460575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433dc0f-1504-42dc-b1b5-7e8f210167b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.461283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433dc0f-1504-42dc-b1b5-7e8f210167b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.461570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433dc0f-1504-42dc-b1b5-7e8f210167b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.461850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433dc0f-1504-42dc-b1b5-7e8f210167b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.462600 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433dc0f-1504-42dc-b1b5-7e8f210167b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:00.462908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433dc0f-1504-42dc-b1b5-7e8f210167b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:00.464303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433dc0f-1504-42dc-b1b5-7e8f210167b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:00.474470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 408/794] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:00.475964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305fd67-ea86-4b10-ad6b-8c77b65a60f8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.476257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305fd67-ea86-4b10-ad6b-8c77b65a60f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.476538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305fd67-ea86-4b10-ad6b-8c77b65a60f8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.482001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 409/795] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:00.482001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305fd67-ea86-4b10-ad6b-8c77b65a60f8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.498434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489653-4811-4f4f-9daa-70bea30d8e2a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.536916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc4280-6d9e-4cfd-bfd2-f4f7bd8b5ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.538115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4280-6d9e-4cfd-bfd2-f4f7bd8b5ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.538637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4280-6d9e-4cfd-bfd2-f4f7bd8b5ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.539116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4280-6d9e-4cfd-bfd2-f4f7bd8b5ad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.546688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc4280-6d9e-4cfd-bfd2-f4f7bd8b5ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:00.548423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc4280-6d9e-4cfd-bfd2-f4f7bd8b5ad8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c3fc4280-6d9e-4cfd-bfd2-f4f7bd8b5ad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:00.563524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:00.564454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:00.565420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:00.568645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 387/796] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:00.570262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18302a-8d53-4797-a02d-b092ee432b96 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.570760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18302a-8d53-4797-a02d-b092ee432b96 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.571242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18302a-8d53-4797-a02d-b092ee432b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.589502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4e18302a-8d53-4797-a02d-b092ee432b96 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:00.591072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4e18302a-8d53-4797-a02d-b092ee432b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:00.605647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:00.612108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305fd67-ea86-4b10-ad6b-8c77b65a60f8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.637057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:00.672144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.673538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.674029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.674633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.684855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 388/797] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:00.684855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18302a-8d53-4797-a02d-b092ee432b96 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.701923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:00.703729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:00.730118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:00.731072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:00.731978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:00.731978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:00.731978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:00.731978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:00.734241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 410/798] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:00.735246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.805314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18302a-8d53-4797-a02d-b092ee432b96 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.843583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.844785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.845313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.845846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.846987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:00.847687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:00.849373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:00.850761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673fd11-1fea-4add-8f8f-007fd50c85c4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:00.862430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 389/799] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:00.864357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.893428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:00.895269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.895774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.896374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.907349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:00.909942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:00.919993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:00.921060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:00.921926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:00.929425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 411/800] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:00.930621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.947757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:00.980438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178bdf-89b3-4fbc-a7b5-9130fdab4095 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.014504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.015168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.015457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.015739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.016463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.016776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.018181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.034855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 390/801] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.034855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.039797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7653a-a242-4563-8fb2-45fe8e067a18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.075245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bf57f-0130-434f-84be-41020a2c2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.076243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bf57f-0130-434f-84be-41020a2c2257 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.076527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bf57f-0130-434f-84be-41020a2c2257 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.076803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bf57f-0130-434f-84be-41020a2c2257 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/ae32108815704de987d20434ea951c43/roles/4dcc6b65bf2143728b2d8ba9b04eadb7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.092108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bf57f-0130-434f-84be-41020a2c2257 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=ae32108815704de987d20434ea951c43, role_id=4dcc6b65bf2143728b2d8ba9b04eadb7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.093865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bf57f-0130-434f-84be-41020a2c2257 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.107406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 412/802] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:00 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/ae32108815704de987d20434ea951c43/roles/4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:06:01.108664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52b6e6-d8d5-48e3-a0f1-d2bc55fa1f9f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.108997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52b6e6-d8d5-48e3-a0f1-d2bc55fa1f9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.109278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52b6e6-d8d5-48e3-a0f1-d2bc55fa1f9f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.114971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 413/803] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:01.115950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52b6e6-d8d5-48e3-a0f1-d2bc55fa1f9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.139055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.146981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816341-64c9-4a17-ba19-d9773781190b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.187802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947210c-76b5-4b52-8a04-e8b255bc9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.188685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947210c-76b5-4b52-8a04-e8b255bc9d36 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.189006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947210c-76b5-4b52-8a04-e8b255bc9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.189372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947210c-76b5-4b52-8a04-e8b255bc9d36 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.190150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947210c-76b5-4b52-8a04-e8b255bc9d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.190668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947210c-76b5-4b52-8a04-e8b255bc9d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.193300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947210c-76b5-4b52-8a04-e8b255bc9d36 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.206294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 391/804] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.208603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a49f3-22ac-4e65-972f-c2027814e8ad None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.208783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a49f3-22ac-4e65-972f-c2027814e8ad None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.209086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a49f3-22ac-4e65-972f-c2027814e8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.211789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.231608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ad9a49f3-22ac-4e65-972f-c2027814e8ad None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:01.232838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ad9a49f3-22ac-4e65-972f-c2027814e8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:01.270206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52b6e6-d8d5-48e3-a0f1-d2bc55fa1f9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.317478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 392/805] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:01.318706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a49f3-22ac-4e65-972f-c2027814e8ad None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.326537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.327346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.327629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.327930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.340028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.342173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:01.364696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:01.365757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:01.366745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 414/806] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:01.367362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.437430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.458541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a49f3-22ac-4e65-972f-c2027814e8ad None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.500252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de3b8-846a-4d42-8cba-856bf24c9c13 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.503814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.505118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.505403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.505678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.517060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.518547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:01.543388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:01.544390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:01.545390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:01.545390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:01.545390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:01.545390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:01.545390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 393/807] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:01.546117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.644970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.658365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.659504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.660022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.661085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.661957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.663563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.669845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e856145-83b8-44ce-ab84-93a575845d52 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:01.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:01.679105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:06:01.679952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:01.682932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 415/808] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:01.683947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.709454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.710153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.710491 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.710773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.711657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.711993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.713472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.722536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.735638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 394/809] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.736457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.803073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbc99-7b03-40de-a2b4-660e710c2ff7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.839538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.840202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.840484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.840761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.841513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.841815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.843184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.853685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2d45a-7dd4-4e57-be4e-9dd481c6eebb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.857082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 416/810] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.857932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.890821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b35ac0-2a03-4fd3-a895-93824e343a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.891467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b35ac0-2a03-4fd3-a895-93824e343a4c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.891753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b35ac0-2a03-4fd3-a895-93824e343a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.892029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b35ac0-2a03-4fd3-a895-93824e343a4c None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.892759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b35ac0-2a03-4fd3-a895-93824e343a4c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.893067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b35ac0-2a03-4fd3-a895-93824e343a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.894459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b35ac0-2a03-4fd3-a895-93824e343a4c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.899687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 395/811] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.900852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a83bc-dda2-451d-81ae-7a403f63e977 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.901141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a83bc-dda2-451d-81ae-7a403f63e977 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.901418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a83bc-dda2-451d-81ae-7a403f63e977 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.906883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 396/812] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:01.906883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a83bc-dda2-451d-81ae-7a403f63e977 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.921720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.975828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.981107 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e4c2e-ba3c-4778-82fa-d3398248d841 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.018744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.019898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.020013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.020234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.024102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a83bc-dda2-451d-81ae-7a403f63e977 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.031212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.032650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:02.051048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:02.051999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:02.052948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:02.052948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:02.052948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:02.052948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:02.052948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 417/813] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:02.053249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.064420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bb051-5375-4df9-af33-e1ea3e9808f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.065239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb051-5375-4df9-af33-e1ea3e9808f2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.065525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb051-5375-4df9-af33-e1ea3e9808f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.065803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb051-5375-4df9-af33-e1ea3e9808f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.074341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bb051-5375-4df9-af33-e1ea3e9808f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.075789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bb051-5375-4df9-af33-e1ea3e9808f2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-794bb051-5375-4df9-af33-e1ea3e9808f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:02.090066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:02.091050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:02.092004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 397/814] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:02.093073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9284e-804c-40ea-813a-46cdb3a473db None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.093073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9284e-804c-40ea-813a-46cdb3a473db None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.093073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9284e-804c-40ea-813a-46cdb3a473db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.115325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c4a9284e-804c-40ea-813a-46cdb3a473db None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:02.116533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c4a9284e-804c-40ea-813a-46cdb3a473db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:02.161482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.166016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723125-6f20-4237-8422-398fbf0bd8b9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.187681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 398/815] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:02.188510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9284e-804c-40ea-813a-46cdb3a473db None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.211318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.212358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.212771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.213103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.213864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:02.214184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.215565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.221759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 418/816] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:02.221759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.244699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.298301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9284e-804c-40ea-813a-46cdb3a473db None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.333210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2a579-b830-44ce-8fcc-fd146b8e4dc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.333575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.334206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.334486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.334768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.335599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:02.335908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.337317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.350461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 399/817] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:02.351299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.375494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.376503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.377038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.377610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.378857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:02.379355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.381255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.406844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 419/818] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:02.407963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.429967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.455754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62368545-baad-408e-80d0-6461541d89f0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.466833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.494575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.495368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.495655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.495929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] PATH_INFO: `/v3/services/network` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.496572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.497963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:02.511789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:02.512814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:02.513975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 400/819] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:02.514799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.521745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063d82d-5de9-4d03-89bc-1ab054759cdd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.557620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.558327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.558545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.558821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.559548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.561035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.583472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 420/820] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:02.584374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.644038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7b98d-d670-4ee7-a91b-e3e678502a0f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.708795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.709961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.711448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.711927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.712381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.722059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.723921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.739184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d460c-a2f0-4a1f-bffe-6a37431ce866 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:02.744783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:02.745687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:02.746587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:02.749211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 401/821] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:02.750312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.784654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.785405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.785692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.785969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.787423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.862137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.864315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.882314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889647-2172-4ab4-b3a8-709fded3f706 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.919468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.920172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.920459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.920739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.921506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] RBAC: Adding query filter params (name=network) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:02.921799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.923184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.929004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 402/822] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:02.930578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.973990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.008967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 421/823] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:03.009868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.043487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.054111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d2963-37d5-4192-b7b7-42c632a7a612 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.097028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.098500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.098878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.099142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.100045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:03.100424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.102110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.120242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 403/824] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:03.120242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.132374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2e5f5-db7a-44e7-b352-b52bedc12a4e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.167396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.168179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.168471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.168755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.169592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:03.169905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.171312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.177304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 422/825] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:03.177863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.226782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f1c7b-d17e-48cd-802b-82467eb2b75a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.237246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.263147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.263947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.264231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.264842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.275722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.277192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.284329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5a41-6487-4944-aa7f-ef25fe03f8fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:03.294264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:03.295198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:03.296116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:03.296116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:03.296116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:03.296116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:03.296116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 404/826] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:03.296405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.306186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.331420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495ed08-5146-4cb2-ada5-7665322dced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.333298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ed08-5146-4cb2-ada5-7665322dced8 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.333592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ed08-5146-4cb2-ada5-7665322dced8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.333872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495ed08-5146-4cb2-ada5-7665322dced8 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/65e73243951044e4b5beb3de4ebb0a8f/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.336889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ed08-5146-4cb2-ada5-7665322dced8 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=65e73243951044e4b5beb3de4ebb0a8f, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.338343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495ed08-5146-4cb2-ada5-7665322dced8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.360392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 423/827] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:03 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/65e73243951044e4b5beb3de4ebb0a8f/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:06:03.360392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fc69-1b55-45fc-a3e7-a37db476b0fd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.360392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fc69-1b55-45fc-a3e7-a37db476b0fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.360392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fc69-1b55-45fc-a3e7-a37db476b0fd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.360392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 424/828] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:03.360392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6fc69-1b55-45fc-a3e7-a37db476b0fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.427089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa1873-8db4-4719-a68d-747031438f84 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.476155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715cbf3-72a4-479e-95dd-a15610cd48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.477091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715cbf3-72a4-479e-95dd-a15610cd48a3 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.477749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715cbf3-72a4-479e-95dd-a15610cd48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.478044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715cbf3-72a4-479e-95dd-a15610cd48a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.479098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715cbf3-72a4-479e-95dd-a15610cd48a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.480989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715cbf3-72a4-479e-95dd-a15610cd48a3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.498205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.502738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6fc69-1b55-45fc-a3e7-a37db476b0fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.512137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 405/829] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:03.514283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbf47c-d968-4618-9f0c-d66faa07345f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.514283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbf47c-d968-4618-9f0c-d66faa07345f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.514283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbf47c-d968-4618-9f0c-d66faa07345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.539144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-80cbf47c-d968-4618-9f0c-d66faa07345f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:03.540387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-80cbf47c-d968-4618-9f0c-d66faa07345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:03.558562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.559628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.560120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.560603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.561635 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:03.562152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.563834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.578172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 425/830] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:03.585969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.622754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.636878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 406/831] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:03.689443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbf47c-d968-4618-9f0c-d66faa07345f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.740110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad8133-7145-4edb-a7a9-4e3e690074a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.791305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.792429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.792719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.793455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.809114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.810663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:03.826879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:03.827934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:03.828910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 426/832] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:03.836186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.850869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbf47c-d968-4618-9f0c-d66faa07345f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.859439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.893902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.895387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.895679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.895965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.909838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:03.918277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:03.919238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:03.920119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 407/833] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:03.926487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.971116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058718e-48e8-4aa4-a2d9-ddd80444e4a4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.994715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.024934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.026507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.027034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.027984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.029467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.030145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.032160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.058194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 427/834] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:04.059090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec4a84-719f-4244-987e-6eba165c0d8d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.059898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.094587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.095255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.095537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.095818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.096556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.096901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.098814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.107238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 408/835] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:04.114596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.161433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.193487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dd5b7-81e4-4f99-ae6d-d509e59adef1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.230167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.231257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.231821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.232300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.233366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=31fbd8b38e80472e83ee62084cd19d3e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.233887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.235530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.243296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 428/836] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/role_assignments?user.id=31fbd8b38e80472e83ee62084cd19d3e&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:04.244545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917c2e-0597-478b-872e-851ceb68ae72 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.284585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.288711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.289943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.290584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.291281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.305444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.306941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:04.326839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:04.327824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:04.328764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:04.328764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:04.328764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:04.328764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:04.328764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 409/837] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:04.334837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.453044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f10db-5c34-43a8-9d4e-fbf0f73c5d16 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.491166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.492332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.493173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.493662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.494614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.495143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.496729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.507775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.512700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 429/838] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:04.518424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.628059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c98b6-1f78-4fa9-bff2-f0cf1f10cc68 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.666654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.667483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.667773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.668053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.676489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.677986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:04.693289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:04.694260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:04.695210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 410/839] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:04.702206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.809146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9740a08-1ef4-4302-8059-5b64b8844d3e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.846121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb2bdc-8832-478e-9be8-e96041637144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.847143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2bdc-8832-478e-9be8-e96041637144 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.848410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2bdc-8832-478e-9be8-e96041637144 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.848958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb2bdc-8832-478e-9be8-e96041637144 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.850029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb2bdc-8832-478e-9be8-e96041637144 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.850559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb2bdc-8832-478e-9be8-e96041637144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.852210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb2bdc-8832-478e-9be8-e96041637144 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.871694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 430/840] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:04.877569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.896196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6391-af77-476e-a30a-9b10d46802a1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.896749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6391-af77-476e-a30a-9b10d46802a1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.897104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6391-af77-476e-a30a-9b10d46802a1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.898779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 431/841] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:04.904506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a479-f732-4305-ae56-0796a01b0ec3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.904804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a479-f732-4305-ae56-0796a01b0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.905103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a479-f732-4305-ae56-0796a01b0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.915210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.925220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-eeb0a479-f732-4305-ae56-0796a01b0ec3 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:04.927000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eeb0a479-f732-4305-ae56-0796a01b0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:04.982882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.998897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 432/842] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:05.000408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e022-4f6b-4549-ab77-25cb6816b6e8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.022047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a479-f732-4305-ae56-0796a01b0ec3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.047236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.048520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.049278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.050166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.135659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a479-f732-4305-ae56-0796a01b0ec3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.144069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:05.146291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:05.173711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:05.186724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.188341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.188852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.189357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.190710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:05.194171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:05.212308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:05.213375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:05.214225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:05.222764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 433/843] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:05.224500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.266411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 411/844] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:05.267309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.298832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:05.373509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9579-aef2-4397-9b11-3da624edcc57 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.381769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037eb4-f589-470d-8210-5f00f9724f7b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.416866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:05.417229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.418262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.418557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.418868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.419648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:05.419962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:05.421424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:05.431878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 434/845] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:05.432924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.437190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.437837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.438124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.438408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.455468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:05.458421 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:05.486258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:05.487232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:05.489440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:05.489440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:05.489440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:05.489440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:05.491393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 412/846] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:05.497122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.548962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6000-19bf-40e3-99ec-887e9a27e38b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.568407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:05.590384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01058a-07b9-4331-8dbb-f502521a4f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.591317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01058a-07b9-4331-8dbb-f502521a4f39 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.591744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01058a-07b9-4331-8dbb-f502521a4f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.592166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01058a-07b9-4331-8dbb-f502521a4f39 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.593080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01058a-07b9-4331-8dbb-f502521a4f39 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:05.593530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01058a-07b9-4331-8dbb-f502521a4f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:05.595196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01058a-07b9-4331-8dbb-f502521a4f39 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:05.606391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c7287-82e0-441b-b484-8d73c3c7ed24 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.606776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 435/847] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:05.615891 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc54c-0028-4e74-a66b-4c44908362e3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.616192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc54c-0028-4e74-a66b-4c44908362e3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.616461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbc54c-0028-4e74-a66b-4c44908362e3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.618476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 436/848] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:05.624207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031ea6-87c8-468b-a6d8-20933d42a7a2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.624502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031ea6-87c8-468b-a6d8-20933d42a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.624791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031ea6-87c8-468b-a6d8-20933d42a7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.643117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-68031ea6-87c8-468b-a6d8-20933d42a7a2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:05.645260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-68031ea6-87c8-468b-a6d8-20933d42a7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:05.647803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.648565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.648941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.649299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.650105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:05.650488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:05.651957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:05.670510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 413/849] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:05.671717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.724695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:05.747499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 437/850] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:05.770885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031ea6-87c8-468b-a6d8-20933d42a7a2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.808496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a7d5-7c3c-4753-93e4-b816a343b0dd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.847132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.848603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.848980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.849323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.856435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:05.857936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:05.872837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:05.873790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:05.874695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 414/851] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:05.881061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:05.890380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031ea6-87c8-468b-a6d8-20933d42a7a2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:05.904677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:05.936262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:05.937390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:05.937753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:05.938109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:05.952742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:05.960442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:05.961688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:05.962528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 438/852] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:05.967412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.006255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.012664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05f5a3-d054-4731-8b7e-a27dea36ebec None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.067059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.068332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.069314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.069609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.070553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.071012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.072760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.089629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c56656-c415-40f6-a514-ada749717b67 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.092978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 415/853] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:06.097961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.133760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.134854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.135350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.135833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.136769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.137298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.138900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.148858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 439/854] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:06.158501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.202800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.226460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7788ce-dbe0-455a-a3a3-c3f8f5ee1745 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.268597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.270095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.270401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.270686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.271818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=ae32108815704de987d20434ea951c43) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.272142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.273898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.285231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 416/855] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/role_assignments?user.id=ae32108815704de987d20434ea951c43&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:06.298034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7031f-8cdb-4c31-b3e9-c978e54866fb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.339755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a1bc0-9c1c-4f3e-881b-f1a53a63d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.341048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1bc0-9c1c-4f3e-881b-f1a53a63d2ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.341560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1bc0-9c1c-4f3e-881b-f1a53a63d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.342069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1bc0-9c1c-4f3e-881b-f1a53a63d2ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.356306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a1bc0-9c1c-4f3e-881b-f1a53a63d2ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.358280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a1bc0-9c1c-4f3e-881b-f1a53a63d2ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-743a1bc0-9c1c-4f3e-881b-f1a53a63d2ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:06.379324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:06.380483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:06.381405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:06.381405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:06.381405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:06.381405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:06.383867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 440/856] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:06.390034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.421010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.432373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4b9cb-9360-4ce0-828f-dea645148643 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.432700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4b9cb-9360-4ce0-828f-dea645148643 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.432974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4b9cb-9360-4ce0-828f-dea645148643 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.434938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 441/857] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:06.441581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec0ea-c01e-4742-ad12-9aa29220b72a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.441922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec0ea-c01e-4742-ad12-9aa29220b72a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.442158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec0ea-c01e-4742-ad12-9aa29220b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.460135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-89bec0ea-c01e-4742-ad12-9aa29220b72a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:06.461519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89bec0ea-c01e-4742-ad12-9aa29220b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:06.515064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb5bb-0153-4702-9d52-94ab84874b0f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.548305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 442/858] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:06.559325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.559987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.560270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.560550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.561317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.561627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.563005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.571284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec0ea-c01e-4742-ad12-9aa29220b72a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.577756 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 417/859] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:06.583560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.588751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.674021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.694901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750f7e7-3b1b-47b4-a784-c122e4b14f35 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.704090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec0ea-c01e-4742-ad12-9aa29220b72a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.731568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.732224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.732507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.732782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.742056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.743744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.743979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.745056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.745640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.746157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.747057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.748619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:06.759450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:06.760428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:06.761608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 418/860] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:06.763845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:06.764762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:06.765941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:06.767237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.768964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 443/861] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:06.775730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.861960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.886701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5118-8d32-42f6-9091-afea3b0764fc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.907821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfed24c-6f83-4ade-8d82-8133ff13c8ff None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.925117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.926347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.926632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.926905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.927610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.927922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.929348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.938992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 444/862] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:06.939708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.954481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.955761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.956247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.957267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.958595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.959351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.961449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.980712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.990766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 419/863] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:06.991401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.052316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337c2fe-58f2-4faa-b219-14675c9f20ba None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.088739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.090046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.090532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.091255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.092723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:07.093285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.095649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.101312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb817-f7b3-47b4-aa36-c49bf6937743 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.102006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 445/864] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:07.155904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.156577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.156903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.157174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.234964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:07.238100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.239622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.345185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 420/865] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 04:06:07.352186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.367023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:07.460914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc85908-06ab-4c18-9cce-1009235eb2c0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.496967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.497767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.498051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.498327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.509565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.511024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:07.528791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:07.529727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:07.530626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:07.530626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:07.530626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:07.530626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:07.530626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 446/866] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:07.536540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.645732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:07.649678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e16ae-f758-467d-99b2-cc1627e9cfd4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.687810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeecad6-aa9a-4730-94b1-0fdad37f96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.688767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecad6-aa9a-4730-94b1-0fdad37f96a0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.689264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecad6-aa9a-4730-94b1-0fdad37f96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.689717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecad6-aa9a-4730-94b1-0fdad37f96a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.690609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecad6-aa9a-4730-94b1-0fdad37f96a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:07.691735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecad6-aa9a-4730-94b1-0fdad37f96a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.693319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecad6-aa9a-4730-94b1-0fdad37f96a0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.705530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 421/867] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:07.711250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.781773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:07.810736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e7fba-2652-4375-9a62-d6e88a50bfb3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.811021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e7fba-2652-4375-9a62-d6e88a50bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.811582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e7fba-2652-4375-9a62-d6e88a50bfb3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.813669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 422/868] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:07.817596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b817e1-11ac-4456-8f24-1cae7c1998a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.821865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758619d3-82d9-4dd8-83ba-83d61a031472 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.822281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758619d3-82d9-4dd8-83ba-83d61a031472 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.822664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758619d3-82d9-4dd8-83ba-83d61a031472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.843324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-758619d3-82d9-4dd8-83ba-83d61a031472 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:07.844530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-758619d3-82d9-4dd8-83ba-83d61a031472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:07.857654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.858972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.859774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.860200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.870006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.872155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:07.891124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:07.892218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:07.893374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:07.900690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 447/869] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:07.902148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.928853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 423/870] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:07.948880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758619d3-82d9-4dd8-83ba-83d61a031472 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:08.038274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529550-70f6-4d10-990e-3cb2c70d0ac8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:08.058872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:08.059076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:08.070686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758619d3-82d9-4dd8-83ba-83d61a031472 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:08.078995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:08.079669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.079959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.080240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.081361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:08.081361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:08.083736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:08.096866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 448/871] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:08.103093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:08.119729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417bbff-882c-43bf-9b21-87d1f90b8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:08.120406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417bbff-882c-43bf-9b21-87d1f90b8880 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.120706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417bbff-882c-43bf-9b21-87d1f90b8880 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.121029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417bbff-882c-43bf-9b21-87d1f90b8880 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.122342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417bbff-882c-43bf-9b21-87d1f90b8880 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:08.124024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417bbff-882c-43bf-9b21-87d1f90b8880 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:08.148920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 424/872] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:07 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:08.237666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f9bf8-95a2-41e8-bb0f-daa91b1957ef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:08.284997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb36e-6f88-48d7-b241-412a863ec056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:08.285672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb36e-6f88-48d7-b241-412a863ec056 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.285948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb36e-6f88-48d7-b241-412a863ec056 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.286235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb36e-6f88-48d7-b241-412a863ec056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.287085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb36e-6f88-48d7-b241-412a863ec056 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=65e73243951044e4b5beb3de4ebb0a8f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:08.287404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb36e-6f88-48d7-b241-412a863ec056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:08.288984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb36e-6f88-48d7-b241-412a863ec056 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:08.297546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 449/873] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:08 2022] GET /identity/v3/role_assignments?user.id=65e73243951044e4b5beb3de4ebb0a8f&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:08.547844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483215e-648d-4f26-b232-5985279d77b1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.548225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483215e-648d-4f26-b232-5985279d77b1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.548407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483215e-648d-4f26-b232-5985279d77b1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.550072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 425/874] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:08.555832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746be717-410f-46f2-8602-6e9dec47be44 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.556128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746be717-410f-46f2-8602-6e9dec47be44 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.556408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746be717-410f-46f2-8602-6e9dec47be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.574078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-746be717-410f-46f2-8602-6e9dec47be44 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:08.575264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-746be717-410f-46f2-8602-6e9dec47be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:08.607187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:08.649159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 450/875] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:08.675332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483215e-648d-4f26-b232-5985279d77b1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:08.789619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483215e-648d-4f26-b232-5985279d77b1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:08.827048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:08.828192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.828675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.829177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.840608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:08.849224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:08.850187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:08.851044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:08.853821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 426/876] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:08.861923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746be717-410f-46f2-8602-6e9dec47be44 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:08.966269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746be717-410f-46f2-8602-6e9dec47be44 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.001536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.002202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.002487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.002762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.004177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:09.004544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.006076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.014786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 451/877] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:09.022165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.037075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.134524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865772ba-48ab-49f1-9983-347b4a31c346 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.169283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988b05-3f0a-4807-beff-b6f641925e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.170459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988b05-3f0a-4807-beff-b6f641925e16 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.170984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988b05-3f0a-4807-beff-b6f641925e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.171457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988b05-3f0a-4807-beff-b6f641925e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.183162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99988b05-3f0a-4807-beff-b6f641925e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.184941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99988b05-3f0a-4807-beff-b6f641925e16 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-99988b05-3f0a-4807-beff-b6f641925e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:09.203353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:09.204316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:09.205247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:09.205247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:09.205247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:09.205247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:09.207483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 427/878] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:09.213368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.246395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.263341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd054269-9507-4534-9301-2335e649ea21 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.263663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd054269-9507-4534-9301-2335e649ea21 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.263900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd054269-9507-4534-9301-2335e649ea21 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.265591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 428/879] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:09.270706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7dc0e-ccc8-4875-98ce-b06ab4e058fe None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.270994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7dc0e-ccc8-4875-98ce-b06ab4e058fe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.271275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7dc0e-ccc8-4875-98ce-b06ab4e058fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.290549 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e7e7dc0e-ccc8-4875-98ce-b06ab4e058fe None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:09.291739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e7e7dc0e-ccc8-4875-98ce-b06ab4e058fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:09.338682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af47f-f3dc-4485-a3a1-4b8c66023120 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.382498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.390438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.391284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.391420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.391692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.392499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:09.392738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.394529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.405011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 429/880] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:09.411472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 452/881] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:09.416803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7dc0e-ccc8-4875-98ce-b06ab4e058fe None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.427220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.526137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7dc0e-ccc8-4875-98ce-b06ab4e058fe None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.527157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.539151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba2765-9490-43e8-a66f-dbc798e30133 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.562904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.563723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.564111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.564297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.571978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.573495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.576745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.577652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.578149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.578622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.579531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.581101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:09.589408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:09.590455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:09.591410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 430/882] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:09.598654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.608942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 453/883] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:09 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:09.664244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.720249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557fdd-a408-4b47-83cc-fc6ebfa94ae5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.765830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.766500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.766782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.767061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.767887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:09.768199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.769753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.791977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 431/884] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:09.797378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.909575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b20f-4e08-48b8-b206-3a7a9c9c1f7a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.947255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31674c8b-d7c4-4cb3-8b16-ccfc43922736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.948236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31674c8b-d7c4-4cb3-8b16-ccfc43922736 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.948730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31674c8b-d7c4-4cb3-8b16-ccfc43922736 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.949244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31674c8b-d7c4-4cb3-8b16-ccfc43922736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.970306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.027598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31674c8b-d7c4-4cb3-8b16-ccfc43922736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.029420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31674c8b-d7c4-4cb3-8b16-ccfc43922736 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.141015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 454/885] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:10.142888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.255338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfe375-7f3e-4700-994f-8d499a956e67 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.263472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.292463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.293526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.293955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.294375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.306130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.307791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.310903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3cd25-ebe3-47c9-96c4-8ffa3eb81f18 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.311363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3cd25-ebe3-47c9-96c4-8ffa3eb81f18 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.311452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3cd25-ebe3-47c9-96c4-8ffa3eb81f18 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.317044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 455/886] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:10.318486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456c44-cd33-4c76-a2da-af5e8eb7194e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.318607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456c44-cd33-4c76-a2da-af5e8eb7194e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.318810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456c44-cd33-4c76-a2da-af5e8eb7194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:10.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:10.330631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:10.331828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:10.331828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:10.331828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:10.331828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:10.334350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 432/887] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:10.339920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.341236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e9456c44-cd33-4c76-a2da-af5e8eb7194e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:10.342407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e9456c44-cd33-4c76-a2da-af5e8eb7194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:10.392301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.421081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 456/888] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:10.438097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456c44-cd33-4c76-a2da-af5e8eb7194e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.455111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3dec-e04c-413d-b749-cd44be440211 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.494541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde152b5-13cb-47b0-98bd-8a630fdb6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.495201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde152b5-13cb-47b0-98bd-8a630fdb6c3b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.495483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde152b5-13cb-47b0-98bd-8a630fdb6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.495759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde152b5-13cb-47b0-98bd-8a630fdb6c3b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.496471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde152b5-13cb-47b0-98bd-8a630fdb6c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:10.496776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde152b5-13cb-47b0-98bd-8a630fdb6c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.498166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde152b5-13cb-47b0-98bd-8a630fdb6c3b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.517911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 433/889] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:10.517911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad76241-d62d-4148-acaf-f7452cb081c1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.517911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad76241-d62d-4148-acaf-f7452cb081c1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.517911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad76241-d62d-4148-acaf-f7452cb081c1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.517911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 434/890] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:10.519988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad76241-d62d-4148-acaf-f7452cb081c1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.540244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.545942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456c44-cd33-4c76-a2da-af5e8eb7194e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.581207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111373f-5315-442b-8141-043a8c92dfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.582637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111373f-5315-442b-8141-043a8c92dfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.582999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111373f-5315-442b-8141-043a8c92dfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.583349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111373f-5315-442b-8141-043a8c92dfa8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.584077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111373f-5315-442b-8141-043a8c92dfa8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.585658 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111373f-5315-442b-8141-043a8c92dfa8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5111373f-5315-442b-8141-043a8c92dfa8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:10.598818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:10.599794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:10.600639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 457/891] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:10.602022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40779a7f-7bd0-48fd-9fea-16d367ff53b3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.602022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40779a7f-7bd0-48fd-9fea-16d367ff53b3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.602439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40779a7f-7bd0-48fd-9fea-16d367ff53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.620469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-40779a7f-7bd0-48fd-9fea-16d367ff53b3 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:10.621702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-40779a7f-7bd0-48fd-9fea-16d367ff53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:10.633668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad76241-d62d-4148-acaf-f7452cb081c1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.671642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.671963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.672774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.673095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.673381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.680746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.682326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:10.696414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:10.697525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 435/892] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:10.698444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.706966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 458/893] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:10.708071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40779a7f-7bd0-48fd-9fea-16d367ff53b3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.798074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.816493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40779a7f-7bd0-48fd-9fea-16d367ff53b3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.825837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82970f7-e1f8-4001-b1c0-acb13dd5e086 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.854789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.855455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.855738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.856015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.856801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:10.857138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.858582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.863511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.864176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.864466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.864747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.865842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:10.865842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.867153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.876523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 436/894] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:10.876523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.876773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 459/895] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:10.877423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.915598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.977723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3c15-6194-419f-9bd5-a9f4c9fac7ad None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.985953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76bc9d-9b68-42a4-b86c-1c055c0e38d1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.013425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.014232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.014521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.014806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.015460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.016861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.022486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.023344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.023808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.024266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.025328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] RBAC: Adding query filter params (role.id=205cac319d4f4602a2a0bb20e6e0f59f, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=ae32108815704de987d20434ea951c43) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.025838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.027421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:11.029518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:11.030569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:11.031412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 437/896] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:11.032227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.039184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 460/897] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/role_assignments?user.id=ae32108815704de987d20434ea951c43&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=205cac319d4f4602a2a0bb20e6e0f59f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:11.040191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.044790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.170229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d845c-edd9-49d6-a45e-7030a96811b6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.176869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.181453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3489b6-6c91-49bc-ac47-75f2eda852ff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.224036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.224719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.225036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.225323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.226042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.226357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.227743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.230953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.231622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.231910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.232193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.232935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.233254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.234631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.239441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 438/898] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:11.245104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.245567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 461/899] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:11.246823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.329259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.365363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec501a-472e-4e9d-8869-4ad3a538c897 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.375013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fede76-bdfd-4623-ab04-c83dac5888c4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.402665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.403483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.403876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.404265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.405269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] RBAC: Adding query filter params (interface=public, service_id=cab12a22a62c43b3a66877d7726016f6, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.405709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.407196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.413723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 439/900] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/endpoints?service_id=cab12a22a62c43b3a66877d7726016f6&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:11.422237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.427348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33478346-cd42-4b24-9167-297c68565941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.428023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33478346-cd42-4b24-9167-297c68565941 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.428312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33478346-cd42-4b24-9167-297c68565941 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.428596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33478346-cd42-4b24-9167-297c68565941 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.429364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33478346-cd42-4b24-9167-297c68565941 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.429677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33478346-cd42-4b24-9167-297c68565941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.431065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33478346-cd42-4b24-9167-297c68565941 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.436543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 462/901] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:11.541800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abc215-3d2a-4d8f-9ebd-102d7e4d8145 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.579690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7fd60-0ed7-4a28-9951-02e51683c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.580775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7fd60-0ed7-4a28-9951-02e51683c066 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.581308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7fd60-0ed7-4a28-9951-02e51683c066 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.582325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7fd60-0ed7-4a28-9951-02e51683c066 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.583244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7fd60-0ed7-4a28-9951-02e51683c066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.584954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7fd60-0ed7-4a28-9951-02e51683c066 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.586497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.592752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 440/902] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:06:11.766848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59f54-1462-4be2-8f7d-2e6a920f3bc8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.767175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59f54-1462-4be2-8f7d-2e6a920f3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.767411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59f54-1462-4be2-8f7d-2e6a920f3bc8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.769716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 463/903] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:11.775184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de011bc-7537-4efb-b926-14a272c011e0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.775476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de011bc-7537-4efb-b926-14a272c011e0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.775761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de011bc-7537-4efb-b926-14a272c011e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.793302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0de011bc-7537-4efb-b926-14a272c011e0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:11.794507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0de011bc-7537-4efb-b926-14a272c011e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:11.863674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 441/904] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:11.887605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc59f54-1462-4be2-8f7d-2e6a920f3bc8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.916629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.997231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc59f54-1462-4be2-8f7d-2e6a920f3bc8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.031615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.032349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.032634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.032940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.033593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.035126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:12.047783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:12.048775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:12.049903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 464/905] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:12.055633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de011bc-7537-4efb-b926-14a272c011e0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.161705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de011bc-7537-4efb-b926-14a272c011e0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.201220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:12.209431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.210486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.211148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.211430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.212135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:12.212444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.213860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.219062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 442/906] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:12.225935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.318307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:12.328293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601058-e01b-4eac-ac09-ac86f64c8590 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.363295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.363962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.364246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.364527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.365278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:12.365586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.367023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.372400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 465/907] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:12.378213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.486125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f2c17-8d8a-4b37-bf30-7b8d51a18c87 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.521437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32208667-3040-4dd7-ade5-2c12ec549f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.522088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208667-3040-4dd7-ade5-2c12ec549f6b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.522416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208667-3040-4dd7-ade5-2c12ec549f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.522697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208667-3040-4dd7-ade5-2c12ec549f6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.523473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32208667-3040-4dd7-ade5-2c12ec549f6b None admin] RBAC: Adding query filter params (interface=public, service_id=fac5c4c9b7a74d68a170c085d47743a7, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:12.523783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32208667-3040-4dd7-ade5-2c12ec549f6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.525168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32208667-3040-4dd7-ade5-2c12ec549f6b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.530673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 443/908] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/endpoints?service_id=fac5c4c9b7a74d68a170c085d47743a7&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:12.536158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.641994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78364052-6033-46e4-9b93-aaf9264d3c66 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.679487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72653da-3b40-453e-80c4-b1777fad2a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.680151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72653da-3b40-453e-80c4-b1777fad2a29 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.680433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72653da-3b40-453e-80c4-b1777fad2a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.680711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72653da-3b40-453e-80c4-b1777fad2a29 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.681436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72653da-3b40-453e-80c4-b1777fad2a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.682805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72653da-3b40-453e-80c4-b1777fad2a29 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.688976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 466/909] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:06:13.134900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa2ba7-ac2f-41cb-96af-86545745c46c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.135469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa2ba7-ac2f-41cb-96af-86545745c46c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.135914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa2ba7-ac2f-41cb-96af-86545745c46c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.137704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 444/910] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:13.143345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d66f-9e42-493c-9657-b70c84c173bd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.144018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d66f-9e42-493c-9657-b70c84c173bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.145402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d66f-9e42-493c-9657-b70c84c173bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.162691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-03a9d66f-9e42-493c-9657-b70c84c173bd None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:13.164208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-03a9d66f-9e42-493c-9657-b70c84c173bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:13.178296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:13.235959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 467/911] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:13.259728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa2ba7-ac2f-41cb-96af-86545745c46c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:13.322624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:13.370250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa2ba7-ac2f-41cb-96af-86545745c46c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:13.406259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:13.406995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.407277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.407558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.419216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:13.427801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:13.428761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:13.429819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 445/912] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:13.434896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9d66f-9e42-493c-9657-b70c84c173bd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:13.539807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9d66f-9e42-493c-9657-b70c84c173bd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:13.576278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c84e1-d4d8-4c31-ac47-c1a3bc63006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:13.577333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c84e1-d4d8-4c31-ac47-c1a3bc63006a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.577847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c84e1-d4d8-4c31-ac47-c1a3bc63006a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.578345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c84e1-d4d8-4c31-ac47-c1a3bc63006a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.579288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c84e1-d4d8-4c31-ac47-c1a3bc63006a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:13.579795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c84e1-d4d8-4c31-ac47-c1a3bc63006a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:13.581448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c84e1-d4d8-4c31-ac47-c1a3bc63006a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:13.590184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 468/913] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:13.595979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:13.629443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aced2-b124-4383-8147-162a9d725ec0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.630078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aced2-b124-4383-8147-162a9d725ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.630647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aced2-b124-4383-8147-162a9d725ec0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.632374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 469/914] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:13.638278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed62cf-ba81-42f0-b37a-e65f29622f48 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.638818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed62cf-ba81-42f0-b37a-e65f29622f48 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.639755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed62cf-ba81-42f0-b37a-e65f29622f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.663101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cfed62cf-ba81-42f0-b37a-e65f29622f48 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:13.665015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cfed62cf-ba81-42f0-b37a-e65f29622f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:13.670082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:13.728565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912d418-8461-4b1a-a66e-0da6bd1dcac4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:13.750986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:13.764923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 470/915] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:13.772389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:13.773232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.773519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.773801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.780964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed62cf-ba81-42f0-b37a-e65f29622f48 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:13.789957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:13.792035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:13.818185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:13.819216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:13.820131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:13.820131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:13.820131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:13.820131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:13.824713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 446/916] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:13.826748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:13.912510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed62cf-ba81-42f0-b37a-e65f29622f48 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:13.946557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a24d-e5f2-452f-96f6-e6dd219ce6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:13.947147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a24d-e5f2-452f-96f6-e6dd219ce6b4 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.947432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a24d-e5f2-452f-96f6-e6dd219ce6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.947708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a24d-e5f2-452f-96f6-e6dd219ce6b4 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.948480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a24d-e5f2-452f-96f6-e6dd219ce6b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:13.949872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fba769-1f43-4808-93fd-7ebb1a367105 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:13.950009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a24d-e5f2-452f-96f6-e6dd219ce6b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:13.958963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:13.965036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 471/917] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:13 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:13.966320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82312d-77db-423f-a17d-34a6e1136e38 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.966719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82312d-77db-423f-a17d-34a6e1136e38 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.967308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82312d-77db-423f-a17d-34a6e1136e38 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.973353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 472/918] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:13.974817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877b17-2992-4f3a-939f-6b8ed2fb3d89 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.975109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877b17-2992-4f3a-939f-6b8ed2fb3d89 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.975390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877b17-2992-4f3a-939f-6b8ed2fb3d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.994938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d2877b17-2992-4f3a-939f-6b8ed2fb3d89 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:13.996277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d2877b17-2992-4f3a-939f-6b8ed2fb3d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:14.016778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.017806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.018458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.020161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.021150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.021646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.023974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.046004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 447/919] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:14.047317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.082574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.100718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 473/920] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:14.127563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2877b17-2992-4f3a-939f-6b8ed2fb3d89 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.191511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbdfcf-e3ce-4dd0-b06c-ac84acd96cb5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.227002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.227737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.228017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.228294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.239474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.241424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:14.259610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:14.261073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:14.262033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:14.263580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2877b17-2992-4f3a-939f-6b8ed2fb3d89 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.269604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 448/921] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:14.270720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.298992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.299947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.300934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.301315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.302128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.303614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:14.317012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:14.318288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:14.319164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 474/922] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:14.320078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.325143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.370212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.388719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213743-f827-47bf-903e-fb15399a4305 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.426637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.427662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.428151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.428659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.429720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.430263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.431903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.432461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e56d-30f2-4c64-b8cf-e2e9053d8fd1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.455808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 449/923] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:14.457175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.468640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43174-3af6-4382-8a07-f819646007be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.469590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43174-3af6-4382-8a07-f819646007be None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.469966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43174-3af6-4382-8a07-f819646007be None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.470245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43174-3af6-4382-8a07-f819646007be None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.471006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43174-3af6-4382-8a07-f819646007be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.471313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43174-3af6-4382-8a07-f819646007be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.473026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43174-3af6-4382-8a07-f819646007be None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.483147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 475/924] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:14.484229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43174-3af6-4382-8a07-f819646007be None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.551264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.591620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfacea-2d08-4bf7-aed0-4cf77c895393 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.600095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43174-3af6-4382-8a07-f819646007be None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.637601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.638440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.638776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.639123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.639929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.640339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.641338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.641869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.642540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.643001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.643723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.655210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 476/925] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:14.655210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.658923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.662592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.664729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:14.694296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:14.695261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:14.696169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:14.696169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:14.696169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:14.696169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:14.700678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 450/926] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:14.701868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.775781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc26207-e14e-437d-8c2f-f9ace5f3c363 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.799321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.812399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6a6fc-ba41-445d-b5df-8890ed6d4d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.813085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6a6fc-ba41-445d-b5df-8890ed6d4d77 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.813367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6a6fc-ba41-445d-b5df-8890ed6d4d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.813723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6a6fc-ba41-445d-b5df-8890ed6d4d77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.814379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6a6fc-ba41-445d-b5df-8890ed6d4d77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.816314 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6a6fc-ba41-445d-b5df-8890ed6d4d77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.822614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa980c-8a22-4f16-9c9c-356fe4542de4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.840865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 477/927] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:14.840865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1031911-7d82-4224-9cee-1d825be6ce8d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.840865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1031911-7d82-4224-9cee-1d825be6ce8d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.840865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1031911-7d82-4224-9cee-1d825be6ce8d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.840865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 478/928] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:14.845138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d109398-72df-41e5-8848-bfa3d10c7d27 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.845460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d109398-72df-41e5-8848-bfa3d10c7d27 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.845709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d109398-72df-41e5-8848-bfa3d10c7d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.872863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0d109398-72df-41e5-8848-bfa3d10c7d27 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:14.874201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0d109398-72df-41e5-8848-bfa3d10c7d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:14.883101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.883936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.884324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.884727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.885647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.886056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.887647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.905267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 451/929] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:14.907272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.961001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 479/930] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:14.980430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.991942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d109398-72df-41e5-8848-bfa3d10c7d27 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.049829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a1a57-ee6f-4bed-9088-1f6929de889a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.093321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.094391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.094837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.095274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.104464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.106205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:15.121189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:15.122241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:15.123216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 452/931] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:15.128113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.129718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d109398-72df-41e5-8848-bfa3d10c7d27 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.140558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.170377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.171775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.172356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.172882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.173924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.176167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:15.194925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:15.196017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:06:15.196990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:15.203564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 480/932] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:15.205715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.248150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c506c-572a-4de7-a369-3afbf0cc482d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.260440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.287066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.287805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.288012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.288293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.289188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:15.289545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.291146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.310325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 453/933] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:15.311091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.350063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b1f43-7761-48b3-b17b-aaf2f0b94c10 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.387256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.388036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.388217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.388531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.389313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:15.389601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.390996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.397289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 481/934] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:15.403198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.439261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.447679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721733f-ffe3-48c4-a869-835794bdd8bb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.485517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.486563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.486950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.487339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/ae32108815704de987d20434ea951c43/roles/205cac319d4f4602a2a0bb20e6e0f59f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.490002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=ae32108815704de987d20434ea951c43, role_id=205cac319d4f4602a2a0bb20e6e0f59f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.491723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.516738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 454/935] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:15 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/ae32108815704de987d20434ea951c43/roles/205cac319d4f4602a2a0bb20e6e0f59f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:06:15.526647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ccf4-51a1-4df5-9924-5602ce3b5141 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.567000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf9a1c-a6d4-49ef-8e86-d29fa8d741d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.568384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf9a1c-a6d4-49ef-8e86-d29fa8d741d5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.568852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf9a1c-a6d4-49ef-8e86-d29fa8d741d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.569287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf9a1c-a6d4-49ef-8e86-d29fa8d741d5 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.570169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf9a1c-a6d4-49ef-8e86-d29fa8d741d5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:15.570637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf9a1c-a6d4-49ef-8e86-d29fa8d741d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.572230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf9a1c-a6d4-49ef-8e86-d29fa8d741d5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.578618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 482/936] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:15.584683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.624056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.712108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6af8a-5d78-4c8b-99de-911c45f9bb96 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.749526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f857e4-0614-4312-9607-07bb2f48fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.750187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f857e4-0614-4312-9607-07bb2f48fc70 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.750550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f857e4-0614-4312-9607-07bb2f48fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.750836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f857e4-0614-4312-9607-07bb2f48fc70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.751588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f857e4-0614-4312-9607-07bb2f48fc70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.752999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f857e4-0614-4312-9607-07bb2f48fc70 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.775603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 455/937] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:16.138954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58a65-6cb7-422c-8174-8e844fed61af None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.139359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58a65-6cb7-422c-8174-8e844fed61af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.139556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58a65-6cb7-422c-8174-8e844fed61af None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.141221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 483/938] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:16.147620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6da27-02df-408c-a214-d4eae0ab90bc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.147925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6da27-02df-408c-a214-d4eae0ab90bc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.148199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6da27-02df-408c-a214-d4eae0ab90bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.164946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f6a6da27-02df-408c-a214-d4eae0ab90bc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:16.166149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f6a6da27-02df-408c-a214-d4eae0ab90bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:16.244752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 456/939] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:16.267813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58a65-6cb7-422c-8174-8e844fed61af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:16.372028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:16.375805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58a65-6cb7-422c-8174-8e844fed61af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:16.410981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:16.411714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.411996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.412272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.412943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:16.414376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:16.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:16.428285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:16.429164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 484/940] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:16.434924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6da27-02df-408c-a214-d4eae0ab90bc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:16.449271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:16.541459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6da27-02df-408c-a214-d4eae0ab90bc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:16.576092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:16.576755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.577065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.577341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.578042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:16.578346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:16.579712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:16.585621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 457/941] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:16.591145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:16.699835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444e55-730e-4670-9d86-7d9eb48c9d4c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:16.736949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:16.738608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.738894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.739172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.739888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:16.740194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:16.741705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:16.747783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 485/942] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:16.757947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:16.836138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:16.859762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f4ed-986e-4448-8418-f4530551d333 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:16.894691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa083-c5e5-49a1-92f9-f48c6717f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:16.895350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa083-c5e5-49a1-92f9-f48c6717f896 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.895643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa083-c5e5-49a1-92f9-f48c6717f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.895929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa083-c5e5-49a1-92f9-f48c6717f896 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.896795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa083-c5e5-49a1-92f9-f48c6717f896 None admin] RBAC: Adding query filter params (interface=public, service_id=3dd92bc6c0b94f3ab53c608a9f13b778, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:16.897157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa083-c5e5-49a1-92f9-f48c6717f896 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:16.898542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa083-c5e5-49a1-92f9-f48c6717f896 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:16.908274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 458/943] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:06:16 2022] GET /identity/v3/endpoints?service_id=3dd92bc6c0b94f3ab53c608a9f13b778&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:16.910513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:16.941768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:17.021531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd0ed-9610-441b-9460-270bbc33f055 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:17.060729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:17.061805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.062303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.062782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.063689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:17.065291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:17.070157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d4891-33de-46dd-a67c-58c9c31940af None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.070457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d4891-33de-46dd-a67c-58c9c31940af None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.070749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d4891-33de-46dd-a67c-58c9c31940af None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.072407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 459/944] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:17.074433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 486/945] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:16 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:06:17.079088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa0464-74f5-4ffa-a575-7873242f9649 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.079389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa0464-74f5-4ffa-a575-7873242f9649 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.079679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa0464-74f5-4ffa-a575-7873242f9649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.099224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-50aa0464-74f5-4ffa-a575-7873242f9649 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:17.100460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-50aa0464-74f5-4ffa-a575-7873242f9649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:17.177953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 460/946] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:17.201574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:17.302832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:17.312855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f64d-50cc-4974-8e4c-4ae6e3ebb335 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:17.349636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:17.350306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.350637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.350926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.351638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:17.353106 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:17.354483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING keystone.server.flask.common [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 04:06:17.375986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.sql.core [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 04:06:17.375986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 04:06:17.375986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [parameters: {'id': 'a3a1da616f654d0ab970ec8be0b6769a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 04:06:17.375986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3a1da616f654d0ab970ec8be0b6769a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3a1da616f654d0ab970ec8be0b6769a. Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:06:17.394111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 04:06:17.395089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application yield resource Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise self.value Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application session.commit() Jul 21 04:06:17.396057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.flush() Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application compat.raise_( Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 04:06:17.397032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 04:06:17.397976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:06:17.398792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [parameters: {'id': 'a3a1da616f654d0ab970ec8be0b6769a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:17.399680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:17.400503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3a1da616f654d0ab970ec8be0b6769a. Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:17.403586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 487/947] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Jul 21 04:06:17 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:17.404941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa0464-74f5-4ffa-a575-7873242f9649 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:17.477846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:17.513031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa0464-74f5-4ffa-a575-7873242f9649 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:17.553375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c83d96-35d2-4a04-8bc0-945d7b2d43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:17.554175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c83d96-35d2-4a04-8bc0-945d7b2d43a3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.554457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c83d96-35d2-4a04-8bc0-945d7b2d43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.554735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c83d96-35d2-4a04-8bc0-945d7b2d43a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.562080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c83d96-35d2-4a04-8bc0-945d7b2d43a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:17.563540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c83d96-35d2-4a04-8bc0-945d7b2d43a3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-23c83d96-35d2-4a04-8bc0-945d7b2d43a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:17.578136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:17.579070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:17.579986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 461/948] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:17.586215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:17.700462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64328-665e-48e3-b6c6-f6b96603035c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:17.737078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbd815-c937-4a82-845b-7449ddd851cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:17.737730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbd815-c937-4a82-845b-7449ddd851cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.738021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbd815-c937-4a82-845b-7449ddd851cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.738307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbd815-c937-4a82-845b-7449ddd851cb None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.739078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbd815-c937-4a82-845b-7449ddd851cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:17.739393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbd815-c937-4a82-845b-7449ddd851cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:17.741082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbd815-c937-4a82-845b-7449ddd851cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:17.762719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 488/949] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:17.779018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeee64-1b08-4416-949c-0ee375a39d14 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.779340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeee64-1b08-4416-949c-0ee375a39d14 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.779589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeee64-1b08-4416-949c-0ee375a39d14 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.781069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 462/950] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:17.787222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452b4d-4ff6-4144-ae82-4b947a37d02d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.787556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452b4d-4ff6-4144-ae82-4b947a37d02d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.787796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452b4d-4ff6-4144-ae82-4b947a37d02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.806994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1b452b4d-4ff6-4144-ae82-4b947a37d02d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:17.808557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1b452b4d-4ff6-4144-ae82-4b947a37d02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:17.810852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:17.892960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 489/951] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:17.912978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeee64-1b08-4416-949c-0ee375a39d14 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:17.980383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd3709-889b-45b7-932f-2174f0f2ff56 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.981070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd3709-889b-45b7-932f-2174f0f2ff56 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.981558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd3709-889b-45b7-932f-2174f0f2ff56 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.983392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 490/952] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:17.989416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31eb79c-7a4c-44e1-828d-86cbe9b27069 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.989943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31eb79c-7a4c-44e1-828d-86cbe9b27069 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.990447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31eb79c-7a4c-44e1-828d-86cbe9b27069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.010660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b31eb79c-7a4c-44e1-828d-86cbe9b27069 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:18.012299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b31eb79c-7a4c-44e1-828d-86cbe9b27069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:18.032642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeee64-1b08-4416-949c-0ee375a39d14 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.069937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.077272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.078138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.078419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.078696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.092706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 491/953] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:18.093423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:18.102293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:18.103405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:18.104622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:18.107036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 463/954] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:18.116869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31eb79c-7a4c-44e1-828d-86cbe9b27069 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.119239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.196487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.231816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31eb79c-7a4c-44e1-828d-86cbe9b27069 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.251401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e4f0-401c-4923-92f8-43204f318d7e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.272359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.273063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.273349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.273625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.274383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:18.274811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.276204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.286631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 492/955] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:18.292048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.292784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.293790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.294172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.294599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.295658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.298265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:18.316624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:18.318647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:18.319976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 464/956] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:18.324425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.401631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.413540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94616-e561-4761-94ff-702fb06d3b2b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.449140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.456208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.457936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.458294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.458652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.466560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7331f-894c-48b5-879d-ee97750b4adf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.473156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.474702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:18.497279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:18.498256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:18.499177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:18.499177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:18.499177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:18.499177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:18.500952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 493/957] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:18.504094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.514658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.515378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.515663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.515989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.516702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:18.517075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.519171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.530960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 465/958] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:18.531953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.623159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a92715-d0a0-4a35-ac05-a849696ed975 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.640261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c3a58-9f17-4762-8295-d5bdf05e8246 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.658519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.673677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.674547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.675594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.676021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.677013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:18.677480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.679000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.679418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.680184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.680570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.681006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.681816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:18.682240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.683744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.693229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 466/959] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:18.693949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 494/960] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:18.702130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.816524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832c76-5351-49ff-aff2-122cf0ac4fa8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.854037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.854865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.855156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.855441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.864445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.865935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:18.882089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:18.883110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:18.884100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 467/961] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:18.889279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.936740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.001269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c89a36-e35c-4738-89b5-f1639a2a4e25 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.042761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aad351-8dd6-4de3-b687-d9a7583aa5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.043799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad351-8dd6-4de3-b687-d9a7583aa5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.044316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad351-8dd6-4de3-b687-d9a7583aa5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.044924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad351-8dd6-4de3-b687-d9a7583aa5a4 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.046011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aad351-8dd6-4de3-b687-d9a7583aa5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:19.046530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aad351-8dd6-4de3-b687-d9a7583aa5a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.048167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aad351-8dd6-4de3-b687-d9a7583aa5a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.067347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 495/962] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:19.074120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.127371 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.191566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a1ba-6c38-4a26-8620-29afbbf7829d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.229892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.230929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.231427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.231917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.251906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784ef99-8f56-43ae-80ae-491b8764bbb2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.252213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784ef99-8f56-43ae-80ae-491b8764bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.252478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784ef99-8f56-43ae-80ae-491b8764bbb2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.254827 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 496/963] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:19.260692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae164b-a5a8-48d2-82eb-1ee119685074 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.261303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae164b-a5a8-48d2-82eb-1ee119685074 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.261810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae164b-a5a8-48d2-82eb-1ee119685074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.279569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1eae164b-a5a8-48d2-82eb-1ee119685074 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:19.281127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1eae164b-a5a8-48d2-82eb-1ee119685074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:19.322444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.323850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.365169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 497/964] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:19.378774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.383898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae164b-a5a8-48d2-82eb-1ee119685074 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.428382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.449078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 468/965] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:19.454241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.529225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae164b-a5a8-48d2-82eb-1ee119685074 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.568083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53435a-192c-40d6-8fc6-9496997a8a23 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.578950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.580422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.580911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.582413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.583527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.585395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:19.604346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:19.605648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:19.606716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:19.609519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 498/966] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:19.610535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.611435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.611791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.612142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.615787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.623918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.625557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.627785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:19.647075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:19.648051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:19.649036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:19.649036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:19.649036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:19.649036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:19.654214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 469/967] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:19.654214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.749777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.757459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42a20b-0b5e-47a2-9db0-c5e44e428413 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.791540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705708f-84d3-4c25-8bd5-b48590b722ee None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.793979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.794720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.795719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.795719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.796153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:19.796548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.798051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.804586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 499/968] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:19.812488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.838461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.839057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.839349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.839643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.840636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:19.841001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.842817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.859688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 470/969] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:19.865047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.929259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.946480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a0962a-7ce4-4b8a-a437-fd6e65064e03 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.977893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558d49-5f61-45e1-96f3-07d3b18712a0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.983731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b51332-20e6-4636-a724-1516d38748bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.984404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b51332-20e6-4636-a724-1516d38748bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.984690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b51332-20e6-4636-a724-1516d38748bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.985069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b51332-20e6-4636-a724-1516d38748bc None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.985841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b51332-20e6-4636-a724-1516d38748bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:19.986158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b51332-20e6-4636-a724-1516d38748bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.987569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b51332-20e6-4636-a724-1516d38748bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.993012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 500/970] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:19.994261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33c947-90e0-446a-a244-aee46464afe5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.994550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33c947-90e0-446a-a244-aee46464afe5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.994834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33c947-90e0-446a-a244-aee46464afe5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.996206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 501/971] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:20.000923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33c947-90e0-446a-a244-aee46464afe5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.020993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7abb85-74c6-47dc-b00b-fa17ac45b659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.021796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7abb85-74c6-47dc-b00b-fa17ac45b659 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.022086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7abb85-74c6-47dc-b00b-fa17ac45b659 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.022373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7abb85-74c6-47dc-b00b-fa17ac45b659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.028140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:20.029702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7abb85-74c6-47dc-b00b-fa17ac45b659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.031413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7abb85-74c6-47dc-b00b-fa17ac45b659 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4b7abb85-74c6-47dc-b00b-fa17ac45b659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:20.046900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:20.047815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:20.048730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 471/972] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:20.050100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a710e10-e4e7-4ac0-a749-cd41af6ecc92 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.050100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a710e10-e4e7-4ac0-a749-cd41af6ecc92 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.050472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a710e10-e4e7-4ac0-a749-cd41af6ecc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.067185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1a710e10-e4e7-4ac0-a749-cd41af6ecc92 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:20.068411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1a710e10-e4e7-4ac0-a749-cd41af6ecc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:20.115685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33c947-90e0-446a-a244-aee46464afe5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.144960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 472/973] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:20.146184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a710e10-e4e7-4ac0-a749-cd41af6ecc92 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.162417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.163742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.164249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.165102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.166046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.168300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.193081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 502/974] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:20.193911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.211915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:20.292675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:20.300889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a710e10-e4e7-4ac0-a749-cd41af6ecc92 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.339915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef354bd8-c926-4f7f-8058-e338fa2c0828 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.345235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.345914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.346200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.346480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.347467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:20.347812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.349318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.363271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 473/975] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:20.369729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.391183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.391855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.392135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.392413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.393161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.394608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.410161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.sql.core [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 04:06:20.410161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 04:06:20.410161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [parameters: {'user_id': '86d4292d6e64451b9c4e3aa3c5cbd109', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 04:06:20.410161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jul 21 04:06:20.418047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:06:20.419016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application yield resource Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise self.value Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application session.commit() Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 04:06:20.421650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.flush() Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application compat.raise_( Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 04:06:20.422615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:06:20.423544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:06:20.425822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [parameters: {'user_id': '86d4292d6e64451b9c4e3aa3c5cbd109', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:20.426894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 04:06:20.427920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 503/976] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Jul 21 04:06:20 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:20.429268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.517397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07887fc5-d7d1-4532-be62-44b89187a6d6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.519825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:20.541319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e1fbd-d641-4e9d-bbaa-16e7ac56306b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.555576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.556413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.556789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.557284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.558417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] RBAC: Adding query filter params (role.id=205cac319d4f4602a2a0bb20e6e0f59f, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=ae32108815704de987d20434ea951c43) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:20.558720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.560248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.576854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 474/977] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:20 2022] GET /identity/v3/role_assignments?user.id=ae32108815704de987d20434ea951c43&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=205cac319d4f4602a2a0bb20e6e0f59f => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:20.591458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9be26-5f05-4969-89e7-69e016c16234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.592275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9be26-5f05-4969-89e7-69e016c16234 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.592558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9be26-5f05-4969-89e7-69e016c16234 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.592857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9be26-5f05-4969-89e7-69e016c16234 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.596422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:20.604261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9be26-5f05-4969-89e7-69e016c16234 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.606122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9be26-5f05-4969-89e7-69e016c16234 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-26f9be26-5f05-4969-89e7-69e016c16234 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:20.623436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:20.624421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:20.625406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 504/978] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:20.634190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.755067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897da92-c077-467d-a0dc-4f37e8b68319 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.793583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bbe80-ab71-4409-b809-d94ca9bdf1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.794625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bbe80-ab71-4409-b809-d94ca9bdf1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.795146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bbe80-ab71-4409-b809-d94ca9bdf1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.795631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bbe80-ab71-4409-b809-d94ca9bdf1d3 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.796654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bbe80-ab71-4409-b809-d94ca9bdf1d3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:20.797234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bbe80-ab71-4409-b809-d94ca9bdf1d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.798936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bbe80-ab71-4409-b809-d94ca9bdf1d3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.836293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 475/979] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Jul 21 04:06:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:20.889011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b85-036e-4e5d-9e0f-6fd559397baf None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.889319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b85-036e-4e5d-9e0f-6fd559397baf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.889510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b85-036e-4e5d-9e0f-6fd559397baf None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.894383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 505/980] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:20.900414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ae5b-dbc8-473a-8f39-d12cefa91074 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.901132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ae5b-dbc8-473a-8f39-d12cefa91074 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.901622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68ae5b-dbc8-473a-8f39-d12cefa91074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.921703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ea68ae5b-dbc8-473a-8f39-d12cefa91074 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:20.923383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ea68ae5b-dbc8-473a-8f39-d12cefa91074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:20.947315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:21.002788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 476/981] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:21.027922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5b85-036e-4e5d-9e0f-6fd559397baf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:21.140453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5b85-036e-4e5d-9e0f-6fd559397baf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:21.175556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e6d69-8291-4f94-80c5-7f775efac53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:21.176211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6d69-8291-4f94-80c5-7f775efac53e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:21.176496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6d69-8291-4f94-80c5-7f775efac53e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:21.176778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6d69-8291-4f94-80c5-7f775efac53e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:21.177533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e6d69-8291-4f94-80c5-7f775efac53e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:21.178992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e6d69-8291-4f94-80c5-7f775efac53e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:21.200860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 506/982] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:21 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:22.442853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546efd-95c4-4336-93f4-087236f55a5d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:22.443378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546efd-95c4-4336-93f4-087236f55a5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:22.443458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546efd-95c4-4336-93f4-087236f55a5d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:22.444943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 477/983] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:22.449973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bcc28-0ef0-4fb3-9a38-1e7e65bb179c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:22.450393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bcc28-0ef0-4fb3-9a38-1e7e65bb179c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:22.450620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bcc28-0ef0-4fb3-9a38-1e7e65bb179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:22.468312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bb3bcc28-0ef0-4fb3-9a38-1e7e65bb179c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:22.469863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bb3bcc28-0ef0-4fb3-9a38-1e7e65bb179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:22.526479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:22.552866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 507/984] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:22.574554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546efd-95c4-4336-93f4-087236f55a5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:22.679887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546efd-95c4-4336-93f4-087236f55a5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:22.714305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50c7e6-e6fb-4f67-b3b8-a1ea26bae536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:22.715033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c7e6-e6fb-4f67-b3b8-a1ea26bae536 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:22.715318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c7e6-e6fb-4f67-b3b8-a1ea26bae536 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:22.715596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50c7e6-e6fb-4f67-b3b8-a1ea26bae536 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:22.716298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c7e6-e6fb-4f67-b3b8-a1ea26bae536 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:22.717703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50c7e6-e6fb-4f67-b3b8-a1ea26bae536 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2b50c7e6-e6fb-4f67-b3b8-a1ea26bae536 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:22.730208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:22.731218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:22.732220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 478/985] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:22.733092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bf62a-cd79-401d-aa38-64dfd40a9289 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:22.733092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bf62a-cd79-401d-aa38-64dfd40a9289 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:22.733092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bf62a-cd79-401d-aa38-64dfd40a9289 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:22.733879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 508/986] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:22.738522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bf62a-cd79-401d-aa38-64dfd40a9289 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:22.740022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d913-3d37-48bf-b925-7cca2fcffb8d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:22.740313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d913-3d37-48bf-b925-7cca2fcffb8d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:22.740596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d913-3d37-48bf-b925-7cca2fcffb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:22.759396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f691d913-3d37-48bf-b925-7cca2fcffb8d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:22.760565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f691d913-3d37-48bf-b925-7cca2fcffb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:22.775221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:22.834478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 479/987] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:22.853717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bf62a-cd79-401d-aa38-64dfd40a9289 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:22.857712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691d913-3d37-48bf-b925-7cca2fcffb8d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:22.891175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:22.891849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:22.892134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:22.892421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:22.893172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:22.894101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:22.895634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:22.900507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 509/988] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:22.906088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:22.952270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:22.978616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691d913-3d37-48bf-b925-7cca2fcffb8d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.011866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcefa1-fe83-4b0a-85a7-b2878687ae8a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.015411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.016229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.016514 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.016795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.017475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.019734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:23.031668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:23.032767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:23.034468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 480/989] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Jul 21 04:06:22 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:23.038762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:23.052036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.052458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.052739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.053057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.053765 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:23.054104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.055436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.057033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:23.064902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 510/990] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:23.067575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:23.158233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf679b-d3fe-465d-bcbe-28b1849733b5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.173026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2d84-2a33-46d3-bf10-4699ee248700 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.185469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:23.195492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.196169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.196463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.196742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.197484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] RBAC: Adding query filter params (name=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:23.197796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.199182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.208878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 481/991] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:23.209895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:23.212523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.214003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.214003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.214003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.214556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] RBAC: Adding query filter params (interface=admin, service_id=3dd92bc6c0b94f3ab53c608a9f13b778, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:23.214871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.216229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.222169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 511/992] 10.222.0.45 () {56 vars in 1249 bytes} [Thu Jul 21 04:06:23 2022] GET /identity/v3/endpoints?service_id=3dd92bc6c0b94f3ab53c608a9f13b778&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:23.227647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:23.299103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:23.323417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d4922-7dfa-4727-b09d-228575a47101 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.343429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241416-5e7c-4922-84d5-c83cf2f2c95f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.365545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b7ea6-9a9e-48de-a6d6-9c61b25ad0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.366461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7ea6-9a9e-48de-a6d6-9c61b25ad0ca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.366928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7ea6-9a9e-48de-a6d6-9c61b25ad0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.368144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7ea6-9a9e-48de-a6d6-9c61b25ad0ca None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.369061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b7ea6-9a9e-48de-a6d6-9c61b25ad0ca None admin] RBAC: Adding query filter params (type=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:23.369542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b7ea6-9a9e-48de-a6d6-9c61b25ad0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.370963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b7ea6-9a9e-48de-a6d6-9c61b25ad0ca None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.375732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 482/993] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:23.384074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532c245-4a5b-4356-bc3f-0576926490ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.384897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532c245-4a5b-4356-bc3f-0576926490ff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.385253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532c245-4a5b-4356-bc3f-0576926490ff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.385604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532c245-4a5b-4356-bc3f-0576926490ff None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.386386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532c245-4a5b-4356-bc3f-0576926490ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.387878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532c245-4a5b-4356-bc3f-0576926490ff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.395593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 512/994] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:23 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:06:23.448202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c37e-00bb-4e93-bcdf-e7268dc04df9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.448760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c37e-00bb-4e93-bcdf-e7268dc04df9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.448760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c37e-00bb-4e93-bcdf-e7268dc04df9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.450301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 483/995] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:23.456847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c390-8c91-408a-8b23-46635a2fdf66 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.457412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c390-8c91-408a-8b23-46635a2fdf66 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.457492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c390-8c91-408a-8b23-46635a2fdf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.476312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1019c390-8c91-408a-8b23-46635a2fdf66 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:23.477593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1019c390-8c91-408a-8b23-46635a2fdf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:23.515188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:23.559488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 513/996] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:23.583533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c37e-00bb-4e93-bcdf-e7268dc04df9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:23.697650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c37e-00bb-4e93-bcdf-e7268dc04df9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.733964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.734764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.735053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.735336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.736060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.738317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:23.750813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:23.751864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:23.752778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 484/997] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:23.760238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c390-8c91-408a-8b23-46635a2fdf66 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:23.866254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c390-8c91-408a-8b23-46635a2fdf66 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:23.901408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:23.902095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:23.902381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:23.902662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:23.903371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:23.903681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:23.905127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:23.915127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 514/998] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:23.916167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:23.926533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:24.020561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d6eb5-a9ec-468f-9e42-d1043bc8e861 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:24.055242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:24.055909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.056194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.056472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.057204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:24.057518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:24.058900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:24.069023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 485/999] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:24.070806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:24.103913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:24.175890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125dd8e-5aa2-4499-ac55-ed048b237773 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:24.209620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4ff56-8047-4e46-81fd-4706f99d2dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:24.210273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4ff56-8047-4e46-81fd-4706f99d2dfa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.210558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4ff56-8047-4e46-81fd-4706f99d2dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.210837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4ff56-8047-4e46-81fd-4706f99d2dfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.211621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4ff56-8047-4e46-81fd-4706f99d2dfa None admin] RBAC: Adding query filter params (interface=public, service_id=6bdc2561d75947988b3f0288dd8d738b, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:24.211931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4ff56-8047-4e46-81fd-4706f99d2dfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:24.213453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4ff56-8047-4e46-81fd-4706f99d2dfa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:24.218775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 515/1000] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:06:24 2022] GET /identity/v3/endpoints?service_id=6bdc2561d75947988b3f0288dd8d738b&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:24.224737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:24.294609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:24.326592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b51cdb-67f5-4f02-9895-732c2c227254 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:24.361512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc53d0-00ea-47c9-bba8-8984cf04fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:24.362362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc53d0-00ea-47c9-bba8-8984cf04fd84 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.362690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc53d0-00ea-47c9-bba8-8984cf04fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.363023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc53d0-00ea-47c9-bba8-8984cf04fd84 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.363766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc53d0-00ea-47c9-bba8-8984cf04fd84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:24.365236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc53d0-00ea-47c9-bba8-8984cf04fd84 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:24.377060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 486/1001] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:24 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:06:25.443289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830521-5adb-42ef-a9a5-4587b913c9f4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.443851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830521-5adb-42ef-a9a5-4587b913c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.443851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830521-5adb-42ef-a9a5-4587b913c9f4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.445390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 516/1002] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:25.450638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b80bc6-ed64-4bf8-a1ef-3de76992f38c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.451067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b80bc6-ed64-4bf8-a1ef-3de76992f38c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.451212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b80bc6-ed64-4bf8-a1ef-3de76992f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.468706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec4b7c-6adf-48a9-86ea-9cc3c67b78dd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.469050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-34b80bc6-ed64-4bf8-a1ef-3de76992f38c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:25.469163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec4b7c-6adf-48a9-86ea-9cc3c67b78dd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.469326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec4b7c-6adf-48a9-86ea-9cc3c67b78dd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.470171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-34b80bc6-ed64-4bf8-a1ef-3de76992f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:25.470770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 517/1003] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:25.476469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc93c-c0aa-419d-bcd3-a641a338319c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.476759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc93c-c0aa-419d-bcd3-a641a338319c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.477068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc93c-c0aa-419d-bcd3-a641a338319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.495250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cb4dc93c-c0aa-419d-bcd3-a641a338319c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:25.496450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cb4dc93c-c0aa-419d-bcd3-a641a338319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:25.546174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 487/1004] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:25.568868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 518/1005] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:25.569056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b80bc6-ed64-4bf8-a1ef-3de76992f38c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:25.590861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dc93c-c0aa-419d-bcd3-a641a338319c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:25.618377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:25.633356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:25.680954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b80bc6-ed64-4bf8-a1ef-3de76992f38c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:25.695563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dc93c-c0aa-419d-bcd3-a641a338319c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:25.716369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:25.717053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.717339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.717619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.718330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:25.719694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:25.733239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:25.734473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 488/1006] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:25 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:25.734921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.735101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.735393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.736059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:25.737974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:25.751847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:25.753371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:25.754442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 519/1007] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:25.760148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:25.884411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1e0fd-c173-41c5-8802-17a331567478 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:25.906536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:25.924393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:25.925503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.925890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.926280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.927104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:25.927530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:25.929038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:25.934320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 489/1008] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:25.940721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:26.035245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:26.046493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac36c8-de02-4e05-941b-f53bceaecc13 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:26.080384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c2a24-9b7d-4c04-999f-4490f5406523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:26.081824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c2a24-9b7d-4c04-999f-4490f5406523 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:26.082215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c2a24-9b7d-4c04-999f-4490f5406523 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:26.082596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c2a24-9b7d-4c04-999f-4490f5406523 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:26.083412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c2a24-9b7d-4c04-999f-4490f5406523 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:26.083843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c2a24-9b7d-4c04-999f-4490f5406523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:26.085371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c2a24-9b7d-4c04-999f-4490f5406523 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:26.094997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 520/1009] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:26.096707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:26.198607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f521ea-9404-47dc-b16f-7014e4b5d6f9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:26.234618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eefb92-a8b9-4645-b64e-1d4687789ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:26.235432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eefb92-a8b9-4645-b64e-1d4687789ab8 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:26.235821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eefb92-a8b9-4645-b64e-1d4687789ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:26.236206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eefb92-a8b9-4645-b64e-1d4687789ab8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:26.237708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eefb92-a8b9-4645-b64e-1d4687789ab8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:26.239383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eefb92-a8b9-4645-b64e-1d4687789ab8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:26.254621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 490/1010] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:26.448930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a57ce-87c7-42b0-8aa5-69d2870acbd0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:26.449429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a57ce-87c7-42b0-8aa5-69d2870acbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:26.449429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a57ce-87c7-42b0-8aa5-69d2870acbd0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:26.450996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 521/1011] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:26.456941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d657-77d2-4a7e-9fb4-24394b12427e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:26.457394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d657-77d2-4a7e-9fb4-24394b12427e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:26.457572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d657-77d2-4a7e-9fb4-24394b12427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:26.474744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-85b3d657-77d2-4a7e-9fb4-24394b12427e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:26.475943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-85b3d657-77d2-4a7e-9fb4-24394b12427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:26.516591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:26.553595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 491/1012] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:26.575331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a57ce-87c7-42b0-8aa5-69d2870acbd0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:26.687167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a57ce-87c7-42b0-8aa5-69d2870acbd0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:26.721829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:26.722596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:26.722883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:26.723162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:26.723817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:26.725220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:26.737066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:26.738097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:26.738945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:26.741175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 522/1013] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:26.744504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3d657-77d2-4a7e-9fb4-24394b12427e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:26.847222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3d657-77d2-4a7e-9fb4-24394b12427e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:26.882054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:26.882748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:26.883031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:26.883307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:26.884032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:26.884340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:26.885806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:26.896762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 492/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:26.897990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:26.918705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:27.004949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad969ff3-f8a3-4ba9-bda2-bdd0af18c6aa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:27.039275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7192-2965-4ef9-bedd-220f10256384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:27.039989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7192-2965-4ef9-bedd-220f10256384 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.040273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7192-2965-4ef9-bedd-220f10256384 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.040605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7192-2965-4ef9-bedd-220f10256384 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.041341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7192-2965-4ef9-bedd-220f10256384 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:27.041651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7192-2965-4ef9-bedd-220f10256384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:27.043011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7192-2965-4ef9-bedd-220f10256384 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:27.052887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 523/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:27.054618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:27.089886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:27.158160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a212d4-692a-4451-8062-87f0c37ddd6e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:27.193252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674977d-25b9-4c22-afa2-84dcfcaafd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:27.193901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674977d-25b9-4c22-afa2-84dcfcaafd4b None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.194187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674977d-25b9-4c22-afa2-84dcfcaafd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.194466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674977d-25b9-4c22-afa2-84dcfcaafd4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.195196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674977d-25b9-4c22-afa2-84dcfcaafd4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:27.196567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674977d-25b9-4c22-afa2-84dcfcaafd4b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:27.221659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 493/1016] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:27.828724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb489-3e91-46ea-9d92-02045e529001 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.829262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb489-3e91-46ea-9d92-02045e529001 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.829369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb489-3e91-46ea-9d92-02045e529001 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.832341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 524/1017] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:27.836958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315ba8-08dc-45ea-868c-1fed5e23dfbf None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.837380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315ba8-08dc-45ea-868c-1fed5e23dfbf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.837555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315ba8-08dc-45ea-868c-1fed5e23dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.855092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6c315ba8-08dc-45ea-868c-1fed5e23dfbf None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:27.856295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c315ba8-08dc-45ea-868c-1fed5e23dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:27.931288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 494/1018] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:27.953882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eb489-3e91-46ea-9d92-02045e529001 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:28.041841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:28.061628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eb489-3e91-46ea-9d92-02045e529001 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:28.095575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:28.097010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.097301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.097579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.098290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:28.099596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:28.111234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:28.112337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:28.118512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 525/1019] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Jul 21 04:06:27 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:28.120973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c315ba8-08dc-45ea-868c-1fed5e23dfbf None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:28.139793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:28.224587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c315ba8-08dc-45ea-868c-1fed5e23dfbf None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:28.259255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbff28-6dba-43d9-963a-4f62c7914d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:28.259924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbff28-6dba-43d9-963a-4f62c7914d60 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.260207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbff28-6dba-43d9-963a-4f62c7914d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.260483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbff28-6dba-43d9-963a-4f62c7914d60 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.261212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbff28-6dba-43d9-963a-4f62c7914d60 None admin] RBAC: Adding query filter params (name=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:28.261518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbff28-6dba-43d9-963a-4f62c7914d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:28.262931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbff28-6dba-43d9-963a-4f62c7914d60 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:28.272918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 495/1020] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:28.274761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:28.329470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3243a-3d8b-414c-bda0-e4718aff1f60 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.329755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3243a-3d8b-414c-bda0-e4718aff1f60 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.330033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3243a-3d8b-414c-bda0-e4718aff1f60 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.332844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 496/1021] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:28.338265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e547be3-ebda-4b55-9f50-f8faeb025842 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.338552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e547be3-ebda-4b55-9f50-f8faeb025842 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.338823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e547be3-ebda-4b55-9f50-f8faeb025842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.356170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1e547be3-ebda-4b55-9f50-f8faeb025842 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:28.357798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1e547be3-ebda-4b55-9f50-f8faeb025842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:28.383535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d334ea-1ecd-4d0c-84e0-b54c45768834 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:28.419840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:28.420528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.420841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.421144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.421883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:28.422200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:28.423632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:28.432882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 526/1022] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:28.433078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 497/1023] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:28.436434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:28.450164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:28.457712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e547be3-ebda-4b55-9f50-f8faeb025842 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:28.469644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:28.551791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2315-5ff6-4cae-950c-cb04f69e076e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:28.564761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e547be3-ebda-4b55-9f50-f8faeb025842 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:28.587570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:28.588218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.588508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.588792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.589619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] RBAC: Adding query filter params (interface=public, service_id=42bee0e34af7470a84d646caeb92015a, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:28.589937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:28.591317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:28.596723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 527/1024] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:06:28 2022] GET /identity/v3/endpoints?service_id=42bee0e34af7470a84d646caeb92015a&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:28.602174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:28.605962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:28.606764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.607055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.607338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.608520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:28.610039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:28.616849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 498/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:28.618630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:28.694526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:28.704941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:28.722128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7af66-c047-4bf0-9704-56d69f4d714f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:28.729170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5780f0-9657-4f60-aabf-ddeedf55b3e9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:28.756706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa876e1-6761-4b2a-b073-74b8dd3af664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:28.757420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa876e1-6761-4b2a-b073-74b8dd3af664 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.757722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa876e1-6761-4b2a-b073-74b8dd3af664 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.757984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa876e1-6761-4b2a-b073-74b8dd3af664 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.758672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa876e1-6761-4b2a-b073-74b8dd3af664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:28.760036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa876e1-6761-4b2a-b073-74b8dd3af664 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:28.766278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff6c13-0471-497c-889f-4d8e069aafc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:28.777105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 528/1026] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:28 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:06:28.777317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6c13-0471-497c-889f-4d8e069aafc2 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:28.777317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6c13-0471-497c-889f-4d8e069aafc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:28.777317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6c13-0471-497c-889f-4d8e069aafc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:28.777317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff6c13-0471-497c-889f-4d8e069aafc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:28.777317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff6c13-0471-497c-889f-4d8e069aafc2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:28.805403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 499/1027] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:28 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:29.366149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd18c-47c2-4910-a1bf-0306c613263b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:29.366671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd18c-47c2-4910-a1bf-0306c613263b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:29.366752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd18c-47c2-4910-a1bf-0306c613263b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:29.368372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 529/1028] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:29.373579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3023-4bf7-432a-9c01-fc7e806eb49a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:29.374022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3023-4bf7-432a-9c01-fc7e806eb49a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:29.374170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3023-4bf7-432a-9c01-fc7e806eb49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:29.391542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b3cb3023-4bf7-432a-9c01-fc7e806eb49a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:29.392736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b3cb3023-4bf7-432a-9c01-fc7e806eb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:29.464861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 500/1029] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:29.485783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd18c-47c2-4910-a1bf-0306c613263b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:29.592005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd18c-47c2-4910-a1bf-0306c613263b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:29.626210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:29.626947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:29.627232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:29.628043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:29.634843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:29.639363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:29.647898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:29.649100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:29.650162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:29.652720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 530/1030] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:29.660842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb3023-4bf7-432a-9c01-fc7e806eb49a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:29.719126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:29.762864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb3023-4bf7-432a-9c01-fc7e806eb49a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:29.796556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:29.797247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:29.797532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:29.797810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:29.798554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:29.798862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:29.800856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:29.809410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 501/1031] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:29.814473 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:29.921875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7c16-ab71-4504-8d8c-fa077a8e990a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:29.957025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:29.957912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:29.958192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:29.958473 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:29.970553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:29.972552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:29.991671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:29.992943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:29.993913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:29.993913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:29.993913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:29.993913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:29.997139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 531/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:29.998776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.100624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdecf2-876d-45ac-9dd6-1300e36b4bfa None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.122775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.135014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.135668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.135949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.136228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.136967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:30.137292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.138647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.150847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 502/1033] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:30.156198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.205160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.256148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b463-72bf-428c-bdac-4d03cef34faf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.290319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.291115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.291398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.291674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.299264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.301183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:30.315066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:30.316177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:30.317200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:30.318416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 532/1034] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:30.322325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.428712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049ee6-aac3-4c7a-804e-da2792dcbc86 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.463407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.463997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.464277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.464550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.465410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:30.465722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.467162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.489343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 503/1035] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:30.490600 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.592698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daff34b-d0bc-4305-bc08-cc473edcc4fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.603227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.629177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1409-6825-4781-bb81-b4da1850c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.629839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1409-6825-4781-bb81-b4da1850c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.630128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1409-6825-4781-bb81-b4da1850c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.630411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1409-6825-4781-bb81-b4da1850c3b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.703492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1409-6825-4781-bb81-b4da1850c3b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.707195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1409-6825-4781-bb81-b4da1850c3b2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.810655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 533/1036] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:30.811884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.855839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.867578 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fb70-73c4-4cf8-a56e-539a32ac2987 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.868211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fb70-73c4-4cf8-a56e-539a32ac2987 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.868598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fb70-73c4-4cf8-a56e-539a32ac2987 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.870834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 534/1037] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:30.878180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106d5b-152a-455e-aa6c-3090cf672166 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.878469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106d5b-152a-455e-aa6c-3090cf672166 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.878745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106d5b-152a-455e-aa6c-3090cf672166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.895860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-38106d5b-152a-455e-aa6c-3090cf672166 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:30.897481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-38106d5b-152a-455e-aa6c-3090cf672166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:30.901963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.923027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf75d00-f626-451f-80bc-b8977bbd5eaf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.957305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.958100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.958384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.958660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.968338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.969077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 535/1038] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:30.969802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.970389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b75efc-fed9-4434-a315-71836e45bf64 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.970685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b75efc-fed9-4434-a315-71836e45bf64 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.970967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b75efc-fed9-4434-a315-71836e45bf64 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.972264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 536/1039] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:30.977936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26b3f-09a8-4eaf-b4ad-bf05aad2588e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.978221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26b3f-09a8-4eaf-b4ad-bf05aad2588e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.978495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26b3f-09a8-4eaf-b4ad-bf05aad2588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:30.993521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:30.994663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:30.995630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:30.995630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:30.995630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:30.995630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:30.995630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 504/1040] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:30.995630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.001061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-06a26b3f-09a8-4eaf-b4ad-bf05aad2588e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:31.002257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-06a26b3f-09a8-4eaf-b4ad-bf05aad2588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:31.070518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 537/1041] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:31.071563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a26b3f-09a8-4eaf-b4ad-bf05aad2588e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.090494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:31.102253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9ebf-895e-489b-8df6-e715ab80cb01 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.136288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.137138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.137429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.137713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.138364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.139740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.142028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:31.152437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:31.153539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:31.154393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 505/1042] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:31.155357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.175871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a26b3f-09a8-4eaf-b4ad-bf05aad2588e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.211193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.211890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.212176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.212458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.213214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:31.213522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.214894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.226187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 538/1043] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:31.226977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.256034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9cbb4-c72a-43a0-a984-da151179fda6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.289262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.290047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.290332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.290611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.291790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.293262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.294868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 506/1044] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:31.295631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.324891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:31.327965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ff931-88cb-4a75-863c-2183e45156ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.356836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:31.363326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.363988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.364280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.364566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.365318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] RBAC: Adding query filter params (name=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:31.365634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.367018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.373070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 539/1045] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:31.373832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.403351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5451ba-35ca-414c-9df9-827893ed3c43 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.436227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.437047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.437337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.437617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.444945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.446399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:31.461093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:31.462175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 507/1046] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:31.463102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.473937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405bbf4-5fbb-417b-80ca-aed108644f18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.507962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.508633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.508949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.509238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.509947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.511376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.531896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 540/1047] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:06:31 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:31.532698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.552944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:31.571181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c905e8-19e5-4c24-b76f-d527fb958530 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.609331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:31.613311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.613890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.614216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.614730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.615670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:31.616031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.617902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.629324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 508/1048] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:31.630481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.682125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc398a0-56bc-4a08-a2f2-20dd80b20e66 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.724653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.725357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.725643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.725925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.726718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:31.727029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.728451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.743604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 541/1049] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:31.749171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:31.749593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0717be-5fcc-418d-9dc7-bb0eace650b0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.788862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cea81c-e970-4898-9d69-b0fb3f14ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.789557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cea81c-e970-4898-9d69-b0fb3f14ffc9 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.789842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cea81c-e970-4898-9d69-b0fb3f14ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.790125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cea81c-e970-4898-9d69-b0fb3f14ffc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.790873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cea81c-e970-4898-9d69-b0fb3f14ffc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.792244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cea81c-e970-4898-9d69-b0fb3f14ffc9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.811143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 509/1050] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:31.863548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c96a4-a4f6-4887-9cdc-50dab3d825c6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:31.875987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:31.910532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57910444-3eee-49d2-8ee0-4fb1add8252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:31.911199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57910444-3eee-49d2-8ee0-4fb1add8252d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:31.911481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57910444-3eee-49d2-8ee0-4fb1add8252d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:31.911758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57910444-3eee-49d2-8ee0-4fb1add8252d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:31.912593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57910444-3eee-49d2-8ee0-4fb1add8252d None admin] RBAC: Adding query filter params (role.id=205cac319d4f4602a2a0bb20e6e0f59f, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=31fbd8b38e80472e83ee62084cd19d3e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:31.912943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57910444-3eee-49d2-8ee0-4fb1add8252d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:31.914402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57910444-3eee-49d2-8ee0-4fb1add8252d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:31.920814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 542/1051] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:31 2022] GET /identity/v3/role_assignments?user.id=31fbd8b38e80472e83ee62084cd19d3e&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=205cac319d4f4602a2a0bb20e6e0f59f => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:33.639070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8b31d-093e-4579-a228-cbaf07deb25e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.639604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8b31d-093e-4579-a228-cbaf07deb25e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.639604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8b31d-093e-4579-a228-cbaf07deb25e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.641158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 510/1052] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:33.646891 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d6c2-953d-4c77-9f7e-22f0c3a2d81c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.647306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d6c2-953d-4c77-9f7e-22f0c3a2d81c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.647477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d6c2-953d-4c77-9f7e-22f0c3a2d81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.666267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d981d6c2-953d-4c77-9f7e-22f0c3a2d81c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:33.667466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d981d6c2-953d-4c77-9f7e-22f0c3a2d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:33.738263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 543/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:33.762583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8b31d-093e-4579-a228-cbaf07deb25e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:33.766496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:33.875014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8b31d-093e-4579-a228-cbaf07deb25e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:33.897274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd9b9a-5b24-4300-8bd5-157cd3d5b6e4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.897490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd9b9a-5b24-4300-8bd5-157cd3d5b6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.897776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd9b9a-5b24-4300-8bd5-157cd3d5b6e4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.899161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 544/1054] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:33.903944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fdc08-3a0b-49ce-9bcf-bdd0b013ba8f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.904238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fdc08-3a0b-49ce-9bcf-bdd0b013ba8f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.904524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fdc08-3a0b-49ce-9bcf-bdd0b013ba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.911557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb7283-2956-4678-adda-ba142d4fccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:33.912353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb7283-2956-4678-adda-ba142d4fccd1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.912638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb7283-2956-4678-adda-ba142d4fccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.913002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb7283-2956-4678-adda-ba142d4fccd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.921771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2f6fdc08-3a0b-49ce-9bcf-bdd0b013ba8f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:33.922954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2f6fdc08-3a0b-49ce-9bcf-bdd0b013ba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:33.923273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb7283-2956-4678-adda-ba142d4fccd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f8eb7283-2956-4678-adda-ba142d4fccd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:33.931422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:33.932398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:33.933445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:33.936988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 511/1055] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:33.938321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4508c-82c8-42b9-a43e-3062bfdb4c1b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.938618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4508c-82c8-42b9-a43e-3062bfdb4c1b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.938903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4508c-82c8-42b9-a43e-3062bfdb4c1b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.940201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 512/1056] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:33.940961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4508c-82c8-42b9-a43e-3062bfdb4c1b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:33.999026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 545/1057] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:34.000318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfec49-9971-4128-8925-f710bc5eeffc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.000611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfec49-9971-4128-8925-f710bc5eeffc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.000922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfec49-9971-4128-8925-f710bc5eeffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.008391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.017710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b1cfec49-9971-4128-8925-f710bc5eeffc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:34.019523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b1cfec49-9971-4128-8925-f710bc5eeffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:34.044142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.050603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4508c-82c8-42b9-a43e-3062bfdb4c1b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.085673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.086341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.086632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.086915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.087663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:34.088175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 546/1058] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:34.088288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.088758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfec49-9971-4128-8925-f710bc5eeffc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.089412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.103800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 513/1059] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:34.105648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.189619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfec49-9971-4128-8925-f710bc5eeffc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.206456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58f30-6e83-4c06-b59c-aeba2369c51e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.223699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.224339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.224622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.224932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.230950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.240459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.241364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.241655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.241937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] PATH_INFO: `/v3/users/c979359d38574422a20be888aa75da90` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.253572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.256258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] RBAC: Authorizing `identity:get_user(user_id=c979359d38574422a20be888aa75da90)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.257750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.259430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 514/1060] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/users/c979359d38574422a20be888aa75da90 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:34.260190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.298343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.299913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.362436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27b3f6-0b54-4b77-b76f-29389ad47560 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.398964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.399771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.400063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.400338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.403463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 547/1061] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:34.404307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.410703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:34.418894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:34.420052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 515/1062] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:34.420974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.465939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.466125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.506575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1149-31ae-4504-954e-2a23cf275381 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.522355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345261c-db39-4222-8005-ac561c2c3026 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.539627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.540269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.540548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.540854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.555828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.556605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.556913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.557192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.568497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.569994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:34.587023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:34.587929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:34.588876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:34.588876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:34.588876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:34.588876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:34.588876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 516/1063] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:34.589157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.612939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.614396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.673214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.684071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.692948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249051-b991-47bf-91c4-6ca2d966f498 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.716871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 548/1064] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:34.717851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.726826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.727525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.727807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.728085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.728884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:34.729201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.730584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.739147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 517/1065] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:34.739923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.822187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1358-04b8-47ee-a74c-0365d0c25d40 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.843388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fbffb-da09-4651-b068-3577e146fd49 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:34.855865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.856528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.856813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.857116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.857838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:34.858146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.859528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.871995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 549/1066] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:34.872804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.889069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:34.889959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:34.890246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:34.890529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:34.891817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] RBAC: Authorizing `identity:get_project(project_id=a2bcda48a2284783bfbb9edd5760b91b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:34.894045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:34.895868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 518/1067] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:34.900802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.902160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:34.933745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:34.993345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5aad-20cb-460b-bdf7-334ee93e1a9d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.018675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaf9c6-9b0f-47eb-ac69-b78f26d4fa49 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.038261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.039172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.039996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.039996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.053060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.054542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.056512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.057562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.057862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.058146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.059037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=a2bcda48a2284783bfbb9edd5760b91b, user.id=c979359d38574422a20be888aa75da90) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:35.059354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.060865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.071464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 519/1068] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/role_assignments?user.id=c979359d38574422a20be888aa75da90&scope.project.id=a2bcda48a2284783bfbb9edd5760b91b&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:35.072716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:35.073823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:35.074949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:35.074949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:35.074949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:35.074949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:35.074949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 550/1069] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:35.080390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:35.190524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:35.200860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cf956-1c4c-471b-8ccc-9d85ffcb21c4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.236348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.237792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.238066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.238344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.239066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:35.239376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.240753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.253562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 520/1070] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:35.259255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:35.328284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:35.359248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aadeee-7a1d-4142-8165-0f6cc06a8f68 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.393834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.394619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.394899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.395175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.402880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.404310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:35.418322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:35.419285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:35.420260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 551/1071] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:06:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:35.425910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:35.525154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506fb68-41a8-406c-84fd-a8e1acf0ee03 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.558747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.559415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.559701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.559982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.560808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:35.561155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.562585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.579948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 521/1072] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:06:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:35.585570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:35.683870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ffc28-9a40-49ca-a9cb-286efce55bc6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.712179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:35.717560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.718361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.718651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.718931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.730434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.731881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:35.749607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:35.750692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:35.751624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:35.751624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:35.751624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:35.751624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:35.751624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 552/1073] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:35.756785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:35.767973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:35.856228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2655d-344d-4104-b1b4-6df6cc37fbc4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.889667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.890324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.890613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.890898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.891615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:35.891929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.893375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.904282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 522/1074] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:35.910521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:36.008712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01396-d962-432f-8f2d-977aaac00099 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:36.041075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:36.041859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:36.042142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:36.042418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:36.049745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:36.051193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:36.065526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:36.066575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:36.067533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 553/1075] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:36.072447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:36.138536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:36.174064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226b7b-3471-4bdb-92b5-099480a0e976 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:36.209777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2288bf0-83af-433a-9f61-4f2f97fd25e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:36.210437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2288bf0-83af-433a-9f61-4f2f97fd25e7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:36.210723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2288bf0-83af-433a-9f61-4f2f97fd25e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:36.211003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2288bf0-83af-433a-9f61-4f2f97fd25e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:36.211917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2288bf0-83af-433a-9f61-4f2f97fd25e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:36.212232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2288bf0-83af-433a-9f61-4f2f97fd25e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:36.213715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2288bf0-83af-433a-9f61-4f2f97fd25e7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:36.226460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 523/1076] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:36.232418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:36.277441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:36.329643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f381d-5472-4bd6-934a-e6357c99ea70 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:36.364014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccec802-63cd-4b75-9df8-6c7b8e9ecfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:36.364935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec802-63cd-4b75-9df8-6c7b8e9ecfd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:36.365207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec802-63cd-4b75-9df8-6c7b8e9ecfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:36.365482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec802-63cd-4b75-9df8-6c7b8e9ecfd6 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/31fbd8b38e80472e83ee62084cd19d3e/roles/205cac319d4f4602a2a0bb20e6e0f59f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:36.367877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccec802-63cd-4b75-9df8-6c7b8e9ecfd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=31fbd8b38e80472e83ee62084cd19d3e, role_id=205cac319d4f4602a2a0bb20e6e0f59f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:36.369354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccec802-63cd-4b75-9df8-6c7b8e9ecfd6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:36.382960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 554/1077] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:36 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/31fbd8b38e80472e83ee62084cd19d3e/roles/205cac319d4f4602a2a0bb20e6e0f59f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:06:37.110543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6245070-9783-42dc-81ae-edad1d5b0f6e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.111068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6245070-9783-42dc-81ae-edad1d5b0f6e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.111178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6245070-9783-42dc-81ae-edad1d5b0f6e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.113253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 524/1078] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:37.118723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629855-b3fd-41f0-835c-d0528501b0ec None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.119151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629855-b3fd-41f0-835c-d0528501b0ec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.119294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629855-b3fd-41f0-835c-d0528501b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.135638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bd629855-b3fd-41f0-835c-d0528501b0ec None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:37.136843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd629855-b3fd-41f0-835c-d0528501b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:37.201677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 555/1079] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:37.224236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6245070-9783-42dc-81ae-edad1d5b0f6e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:37.324004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6245070-9783-42dc-81ae-edad1d5b0f6e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:37.350265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:37.358929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:37.359717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.360002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.360280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.370675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:37.378832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:37.379824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:37.380766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:37.384986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 525/1080] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:37.385970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd629855-b3fd-41f0-835c-d0528501b0ec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:37.419067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:37.491000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd629855-b3fd-41f0-835c-d0528501b0ec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:37.525642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:37.526304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.526586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.526864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.527607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:37.527913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:37.529325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:37.538545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 556/1081] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:37.544518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:37.641859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b1e1-fb47-427f-810a-ba3b912aa1dd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:37.678495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:37.679366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.679648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.679921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] PATH_INFO: `/v3/users/c979359d38574422a20be888aa75da90` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.681125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] RBAC: Authorizing `identity:get_user(user_id=c979359d38574422a20be888aa75da90)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:37.682565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:37.684174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 526/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:37 2022] GET /identity/v3/users/c979359d38574422a20be888aa75da90 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:37.690258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:37.781408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:37.788227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a88404-8e36-4c21-8a3d-0fc0021bff9c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:37.821005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3f7d3-65b2-40f2-be2c-4fd44f72e6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:37.821863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f7d3-65b2-40f2-be2c-4fd44f72e6ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.822144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f7d3-65b2-40f2-be2c-4fd44f72e6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.822420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f7d3-65b2-40f2-be2c-4fd44f72e6ec None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.823587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3f7d3-65b2-40f2-be2c-4fd44f72e6ec None admin] RBAC: Authorizing `identity:get_project(project_id=a2bcda48a2284783bfbb9edd5760b91b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:37.825049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3f7d3-65b2-40f2-be2c-4fd44f72e6ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:37.826767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 557/1083] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:37 2022] GET /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:37.834494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:37.891332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:37.935319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585559f0-0553-4c97-abf0-e591be28d643 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:37.968930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bedc4-26dc-411e-b9c1-6d6ca2f1274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:37.969817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bedc4-26dc-411e-b9c1-6d6ca2f1274c None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.970102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bedc4-26dc-411e-b9c1-6d6ca2f1274c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.970380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bedc4-26dc-411e-b9c1-6d6ca2f1274c None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b/users/c979359d38574422a20be888aa75da90/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.972429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bedc4-26dc-411e-b9c1-6d6ca2f1274c None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bcda48a2284783bfbb9edd5760b91b, user_id=c979359d38574422a20be888aa75da90, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:37.973897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bedc4-26dc-411e-b9c1-6d6ca2f1274c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:37.986116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 527/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:37 2022] PUT /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b/users/c979359d38574422a20be888aa75da90/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:06:38.389395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a036069-4eb0-465f-a005-ce6bc22fc5af None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.389925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a036069-4eb0-465f-a005-ce6bc22fc5af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.390015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a036069-4eb0-465f-a005-ce6bc22fc5af None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.391321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 558/1085] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:38.396673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130e3e-5b01-4ba2-8da4-8a4972afe7b7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.397139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130e3e-5b01-4ba2-8da4-8a4972afe7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.397283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130e3e-5b01-4ba2-8da4-8a4972afe7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.414240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-86130e3e-5b01-4ba2-8da4-8a4972afe7b7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:38.415449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-86130e3e-5b01-4ba2-8da4-8a4972afe7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:38.483731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 528/1086] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:38.508525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a036069-4eb0-465f-a005-ce6bc22fc5af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.608512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a036069-4eb0-465f-a005-ce6bc22fc5af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.642338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.643374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.643681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.643960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.653821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:38.663074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:38.664213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:38.665521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 559/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:38.670495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86130e3e-5b01-4ba2-8da4-8a4972afe7b7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.715349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:38.767796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86130e3e-5b01-4ba2-8da4-8a4972afe7b7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.803289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.803949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.804233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.804512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.805286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:38.805596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:38.806972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:38.814928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 529/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:38.820589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.845252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:38.918200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fbfe5-ee02-4014-8157-6f06b1fbcd52 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.950267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.951049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.951330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.951607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.962086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:38.963519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:38.980577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:38.981710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:38.982931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:38.982931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:38.982931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:38.982931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:38.985002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 560/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:38.987920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:39.088354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7eb5-0d04-4c00-a859-346eba85a651 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:39.098686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:39.123743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:39.124401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:39.124682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:39.124995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:39.125712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:39.126021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:39.127578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:39.139128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 530/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:39.145504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:39.220427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:39.243398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9151-f5ca-4ba4-af6b-e07058e84996 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:39.275938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:39.276714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:39.277024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:39.277307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:39.285798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:39.287237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:39.301967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:39.302907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:39.303991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 561/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Jul 21 04:06:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:39.308784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:39.406921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad711b-3b6e-4ffd-91e2-ceadb4eab5ec None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:39.441238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:39.441911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:39.442198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:39.442478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:39.443305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:39.443612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:39.445093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:39.466727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 531/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Jul 21 04:06:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:39.467985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:39.566952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df379f57-c49d-41f3-ba65-e5d9fa712d1f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:39.600078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:39.600724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:39.601038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:39.601317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:39.604875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:39.669537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:39.671114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:39.768402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 562/1093] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:39.774077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:39.803829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:39.874486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764f407-6e4f-458d-ab07-8fae6661070b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:39.907299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3785-1014-4271-8f36-ab8c3331826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:39.908082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3785-1014-4271-8f36-ab8c3331826a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:39.908993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3785-1014-4271-8f36-ab8c3331826a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:39.909270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3785-1014-4271-8f36-ab8c3331826a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:39.919160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3785-1014-4271-8f36-ab8c3331826a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:39.920602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3785-1014-4271-8f36-ab8c3331826a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0e8b3785-1014-4271-8f36-ab8c3331826a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:39.937847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:39.938961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:39.940543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:39.940543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:39.940543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:39.940543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:39.940543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 532/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:39.944677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:39.978639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.012722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9adff-657d-4950-a9e2-e03db4b60d9c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.013045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9adff-657d-4950-a9e2-e03db4b60d9c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.013337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9adff-657d-4950-a9e2-e03db4b60d9c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.014717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 533/1095] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:40.020086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311923-0b82-41a3-98ae-7cddada8bb5d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.020374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311923-0b82-41a3-98ae-7cddada8bb5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.020657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311923-0b82-41a3-98ae-7cddada8bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.037822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-46311923-0b82-41a3-98ae-7cddada8bb5d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:40.039026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-46311923-0b82-41a3-98ae-7cddada8bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:40.044930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b8ba-01fb-4ba5-953a-f7e6f53f39ce None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.078392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.079046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.079329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.079607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.081139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:40.081453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:40.082823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:40.093853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 563/1096] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:40.100065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:40.106943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 534/1097] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:40.131344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46311923-0b82-41a3-98ae-7cddada8bb5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:40.141154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.195907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.202095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90539048-bf31-4b52-8712-2154b0a13699 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.229850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46311923-0b82-41a3-98ae-7cddada8bb5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.235383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.236199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.236629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.236952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.243819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:40.245363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:40.260269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:40.261331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:06:40.262230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 564/1098] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:40.267326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:40.270031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.270833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.271121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.271403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.281890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:40.289673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:40.290575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:40.291443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 535/1099] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:40.296980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:40.362722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.366766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4faa7-490c-4c02-80cb-136cc627cd7e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.402842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.403297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26588c9-8511-4e53-b39f-afb4af490457 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.403413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.403688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.403963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.404772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:40.405111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:40.406546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:40.427123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 565/1100] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:40.428261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:40.438149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.438825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.439120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.440115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.440747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:40.441097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:40.442492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:40.447221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.451385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 536/1101] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:40.457978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:40.529382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470242-5b89-4f0d-96ed-1eaa1984f2b2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.556710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34d6cf-dd98-449a-8f2a-466c9bf39ac1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.562951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.563606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.563889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.564165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.566152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] RBAC: Adding query filter params (role.id=205cac319d4f4602a2a0bb20e6e0f59f, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=31fbd8b38e80472e83ee62084cd19d3e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:40.566470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:40.567893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:40.573739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 566/1102] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/role_assignments?user.id=31fbd8b38e80472e83ee62084cd19d3e&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=205cac319d4f4602a2a0bb20e6e0f59f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:40.590383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.597165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.598072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.598357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.598637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] PATH_INFO: `/v3/users/c979359d38574422a20be888aa75da90` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.599953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] RBAC: Authorizing `identity:get_user(user_id=c979359d38574422a20be888aa75da90)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:40.601472 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:40.603192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 537/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/users/c979359d38574422a20be888aa75da90 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:40.609483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:40.701482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.723243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f646-b36e-4149-9572-8297a8c1bd27 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:40.757353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:40.758010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:40.758304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:40.758586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:40.829432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:40.831571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:40.913840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:40.935817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 567/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:40.942559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:41.048929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904898-d4b6-4225-a352-828789b4cc14 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:41.083522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5b2db-9454-4e95-93b0-3dcc65b33670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:41.084385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5b2db-9454-4e95-93b0-3dcc65b33670 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.084668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5b2db-9454-4e95-93b0-3dcc65b33670 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.084979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5b2db-9454-4e95-93b0-3dcc65b33670 None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.086160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5b2db-9454-4e95-93b0-3dcc65b33670 None admin] RBAC: Authorizing `identity:get_project(project_id=a2bcda48a2284783bfbb9edd5760b91b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:41.087585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5b2db-9454-4e95-93b0-3dcc65b33670 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:41.089299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 538/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:40 2022] GET /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:41.095447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:41.195687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4704f7-8260-453b-8261-c909ee356d82 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:41.229440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b05632-a130-44c1-84e5-1d91b9ad570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:41.230093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05632-a130-44c1-84e5-1d91b9ad570f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.230372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05632-a130-44c1-84e5-1d91b9ad570f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.230646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05632-a130-44c1-84e5-1d91b9ad570f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.231478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b05632-a130-44c1-84e5-1d91b9ad570f None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=a2bcda48a2284783bfbb9edd5760b91b, user.id=c979359d38574422a20be888aa75da90) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:41.231786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b05632-a130-44c1-84e5-1d91b9ad570f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:41.233256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b05632-a130-44c1-84e5-1d91b9ad570f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:41.239586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 568/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:41 2022] GET /identity/v3/role_assignments?user.id=c979359d38574422a20be888aa75da90&scope.project.id=a2bcda48a2284783bfbb9edd5760b91b&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:43.284392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0861e52-5537-47bc-8c66-3273991d2374 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:43.284942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0861e52-5537-47bc-8c66-3273991d2374 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:43.284942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0861e52-5537-47bc-8c66-3273991d2374 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:43.286317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 539/1107] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:43.291530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ecaf-7b38-4748-ba1f-316b385ea394 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:43.291978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ecaf-7b38-4748-ba1f-316b385ea394 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:43.292099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ecaf-7b38-4748-ba1f-316b385ea394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:43.308501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0d54ecaf-7b38-4748-ba1f-316b385ea394 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:43.309720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0d54ecaf-7b38-4748-ba1f-316b385ea394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:43.349133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:43.374831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 569/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:43.400202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0861e52-5537-47bc-8c66-3273991d2374 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:43.466008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:43.502418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0861e52-5537-47bc-8c66-3273991d2374 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:43.534688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f22b05-c969-4e67-8d42-a645da16773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:43.535406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22b05-c969-4e67-8d42-a645da16773c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:43.535694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22b05-c969-4e67-8d42-a645da16773c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:43.535974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22b05-c969-4e67-8d42-a645da16773c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:43.537213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f22b05-c969-4e67-8d42-a645da16773c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:43.538631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f22b05-c969-4e67-8d42-a645da16773c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:43.540218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 540/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:43.545836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54ecaf-7b38-4748-ba1f-316b385ea394 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:43.643015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54ecaf-7b38-4748-ba1f-316b385ea394 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:43.677206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8fe40-26f6-48b8-9f70-43d74421d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:43.677872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8fe40-26f6-48b8-9f70-43d74421d350 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:43.678157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8fe40-26f6-48b8-9f70-43d74421d350 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:43.678437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8fe40-26f6-48b8-9f70-43d74421d350 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:43.679138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8fe40-26f6-48b8-9f70-43d74421d350 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:43.680564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8fe40-26f6-48b8-9f70-43d74421d350 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:43.699639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 570/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:06:43 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:45.751038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d0a1-af4e-4a01-a16e-de1abf69ffef None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:45.751751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d0a1-af4e-4a01-a16e-de1abf69ffef None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:45.751751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d0a1-af4e-4a01-a16e-de1abf69ffef None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:45.753783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 541/1111] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:45.758840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0dfc-c065-4452-8830-048935bf636b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:45.759233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0dfc-c065-4452-8830-048935bf636b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:45.759396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0dfc-c065-4452-8830-048935bf636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:45.775745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c09e0dfc-c065-4452-8830-048935bf636b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:45.776941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c09e0dfc-c065-4452-8830-048935bf636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:45.799975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:45.841706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 571/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:45.865209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37d0a1-af4e-4a01-a16e-de1abf69ffef None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:45.964753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37d0a1-af4e-4a01-a16e-de1abf69ffef None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:45.998150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:45.998998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:45.999286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:45.999564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] PATH_INFO: `/v3/roles/1be9be19909c40699636c4973a021627` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:46.001070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] RBAC: Authorizing `identity:get_role(role_id=1be9be19909c40699636c4973a021627)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:46.003111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:46.004456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 542/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:45 2022] GET /identity/v3/roles/1be9be19909c40699636c4973a021627 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:46.010156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0dfc-c065-4452-8830-048935bf636b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:46.105896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0dfc-c065-4452-8830-048935bf636b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:46.139829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:46.140693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:46.141014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:46.141296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] PATH_INFO: `/v3/users/3b89bcc775c24d8ea29d65328fddc1d4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:46.154225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] RBAC: Authorizing `identity:get_user(user_id=3b89bcc775c24d8ea29d65328fddc1d4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:46.155653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:46.157310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 572/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:46 2022] GET /identity/v3/users/3b89bcc775c24d8ea29d65328fddc1d4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:46.163690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:46.166534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:46.262347 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e5f2-7614-4139-8fc0-3ffad70c6850 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:46.294659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:46.295399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:46.295691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:46.295972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:46.366642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:46.369742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:46.371615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:46.467517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 543/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:46.474207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:46.495426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:46.573688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742f677-2858-4099-8832-87513f1c0750 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:46.606818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea98c01-87db-4ea1-9846-ea3066b26dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:46.607672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea98c01-87db-4ea1-9846-ea3066b26dab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:46.607960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea98c01-87db-4ea1-9846-ea3066b26dab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:46.608243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea98c01-87db-4ea1-9846-ea3066b26dab None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:46.609435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea98c01-87db-4ea1-9846-ea3066b26dab None admin] RBAC: Authorizing `identity:get_project(project_id=a2bcda48a2284783bfbb9edd5760b91b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:46.610914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea98c01-87db-4ea1-9846-ea3066b26dab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:46.612628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 573/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:46 2022] GET /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:46.619395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:46.716973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3b8f-8b66-402b-aa09-760b1b13dc97 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:46.718486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:46.751585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55439a-40ac-444c-a632-2dcb3d4f1192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:46.752330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55439a-40ac-444c-a632-2dcb3d4f1192 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:46.752599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55439a-40ac-444c-a632-2dcb3d4f1192 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:46.752912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55439a-40ac-444c-a632-2dcb3d4f1192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:46.753735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55439a-40ac-444c-a632-2dcb3d4f1192 None admin] RBAC: Adding query filter params (role.id=1be9be19909c40699636c4973a021627, scope.project.id=a2bcda48a2284783bfbb9edd5760b91b, user.id=3b89bcc775c24d8ea29d65328fddc1d4) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:46.754051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55439a-40ac-444c-a632-2dcb3d4f1192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:46.755476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55439a-40ac-444c-a632-2dcb3d4f1192 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:46.760740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 544/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:46 2022] GET /identity/v3/role_assignments?user.id=3b89bcc775c24d8ea29d65328fddc1d4&scope.project.id=a2bcda48a2284783bfbb9edd5760b91b&role.id=1be9be19909c40699636c4973a021627 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:48.763141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956e53-c899-4467-a229-3a97175e4807 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:48.763677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956e53-c899-4467-a229-3a97175e4807 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:48.763677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956e53-c899-4467-a229-3a97175e4807 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:48.765110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 574/1118] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:48.770416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfea3a0-0097-4963-824a-15bf38190a9a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:48.770828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfea3a0-0097-4963-824a-15bf38190a9a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:48.770986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfea3a0-0097-4963-824a-15bf38190a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:48.787414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-abfea3a0-0097-4963-824a-15bf38190a9a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:48.788605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-abfea3a0-0097-4963-824a-15bf38190a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:48.853833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 545/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:48.877369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db956e53-c899-4467-a229-3a97175e4807 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:48.961241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:48.976583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db956e53-c899-4467-a229-3a97175e4807 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:49.010198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:49.011046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:49.011335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:49.011617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] PATH_INFO: `/v3/roles/1be9be19909c40699636c4973a021627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:49.013110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] RBAC: Authorizing `identity:get_role(role_id=1be9be19909c40699636c4973a021627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:49.014484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:49.015843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 575/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:48 2022] GET /identity/v3/roles/1be9be19909c40699636c4973a021627 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:49.021637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfea3a0-0097-4963-824a-15bf38190a9a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:49.113273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:49.119440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfea3a0-0097-4963-824a-15bf38190a9a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:49.152803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:49.153701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:49.153984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:49.154265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] PATH_INFO: `/v3/users/3b89bcc775c24d8ea29d65328fddc1d4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:49.155447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] RBAC: Authorizing `identity:get_user(user_id=3b89bcc775c24d8ea29d65328fddc1d4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:49.156920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:49.159172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 546/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:49 2022] GET /identity/v3/users/3b89bcc775c24d8ea29d65328fddc1d4 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:49.164987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:49.265475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1c3f1-be7c-43c1-ae2c-a69f1b8f20d9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:49.300764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a92144-21dd-4bfa-8e5d-54894628264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:49.301641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a92144-21dd-4bfa-8e5d-54894628264c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:49.301923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a92144-21dd-4bfa-8e5d-54894628264c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:49.302228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a92144-21dd-4bfa-8e5d-54894628264c None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:49.303364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a92144-21dd-4bfa-8e5d-54894628264c None admin] RBAC: Authorizing `identity:get_project(project_id=a2bcda48a2284783bfbb9edd5760b91b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:49.304791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a92144-21dd-4bfa-8e5d-54894628264c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:49.306492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 576/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:49 2022] GET /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:49.312495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:49.409533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57c234-1aec-4298-9e8b-7954bfa885d1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:49.442907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05494c86-cb53-4a00-9719-273a10f23241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:49.443778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05494c86-cb53-4a00-9719-273a10f23241 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:49.444061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05494c86-cb53-4a00-9719-273a10f23241 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:49.444338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05494c86-cb53-4a00-9719-273a10f23241 None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b/users/3b89bcc775c24d8ea29d65328fddc1d4/roles/1be9be19909c40699636c4973a021627` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:49.446524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05494c86-cb53-4a00-9719-273a10f23241 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bcda48a2284783bfbb9edd5760b91b, user_id=3b89bcc775c24d8ea29d65328fddc1d4, role_id=1be9be19909c40699636c4973a021627)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:49.447952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05494c86-cb53-4a00-9719-273a10f23241 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:49.459998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 547/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:49 2022] PUT /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b/users/3b89bcc775c24d8ea29d65328fddc1d4/roles/1be9be19909c40699636c4973a021627 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:06:51.455490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dc932-efb1-4b94-85f7-1b49a743597b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:51.456051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dc932-efb1-4b94-85f7-1b49a743597b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:51.456051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dc932-efb1-4b94-85f7-1b49a743597b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:51.457424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 577/1124] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:51.462476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e0069-8e29-4d59-8b1c-1a1fb6fdb068 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:51.462850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e0069-8e29-4d59-8b1c-1a1fb6fdb068 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:51.463044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e0069-8e29-4d59-8b1c-1a1fb6fdb068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:51.479956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3e6e0069-8e29-4d59-8b1c-1a1fb6fdb068 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:51.481169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3e6e0069-8e29-4d59-8b1c-1a1fb6fdb068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:51.498640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:51.547081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 548/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:51.570941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dc932-efb1-4b94-85f7-1b49a743597b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:51.594708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:51.673029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dc932-efb1-4b94-85f7-1b49a743597b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:51.707015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:51.707808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:51.708097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:51.708379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] PATH_INFO: `/v3/roles/1be9be19909c40699636c4973a021627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:51.709868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] RBAC: Authorizing `identity:get_role(role_id=1be9be19909c40699636c4973a021627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:51.711244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:51.712609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 578/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:51 2022] GET /identity/v3/roles/1be9be19909c40699636c4973a021627 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:51.718363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e0069-8e29-4d59-8b1c-1a1fb6fdb068 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:51.815364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e0069-8e29-4d59-8b1c-1a1fb6fdb068 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:51.848744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:51.849637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:51.849923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:51.850205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] PATH_INFO: `/v3/users/3b89bcc775c24d8ea29d65328fddc1d4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:51.851383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] RBAC: Authorizing `identity:get_user(user_id=3b89bcc775c24d8ea29d65328fddc1d4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:51.852870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:51.854475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 549/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:51 2022] GET /identity/v3/users/3b89bcc775c24d8ea29d65328fddc1d4 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:51.860003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:51.945624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:51.956002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826037d-d0af-4e30-af4e-f223144251ec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:51.988862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:51.989444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:51.989730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:51.990010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:52.055191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:52.056634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:52.141492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:52.152419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 579/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:52.158307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:52.181820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:52.255563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156cde2-6b96-4910-b83c-f927f12cb23a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:52.288637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6506068-a05e-4254-aa68-6dad59915729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:52.289521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506068-a05e-4254-aa68-6dad59915729 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:52.289813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506068-a05e-4254-aa68-6dad59915729 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:52.290097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506068-a05e-4254-aa68-6dad59915729 None admin] PATH_INFO: `/v3/projects/a2bcda48a2284783bfbb9edd5760b91b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:52.291273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6506068-a05e-4254-aa68-6dad59915729 None admin] RBAC: Authorizing `identity:get_project(project_id=a2bcda48a2284783bfbb9edd5760b91b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:52.292723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6506068-a05e-4254-aa68-6dad59915729 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:52.294439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 550/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:52 2022] GET /identity/v3/projects/a2bcda48a2284783bfbb9edd5760b91b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:52.301552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:52.395275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74684a-cccd-48b7-bc29-786a5b125f0d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:52.428240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4210ab3-0cdd-4669-bd7e-e19a4fe0d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:52.428901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4210ab3-0cdd-4669-bd7e-e19a4fe0d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:52.429185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4210ab3-0cdd-4669-bd7e-e19a4fe0d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:52.429460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4210ab3-0cdd-4669-bd7e-e19a4fe0d1c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:52.430273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4210ab3-0cdd-4669-bd7e-e19a4fe0d1c9 None admin] RBAC: Adding query filter params (role.id=1be9be19909c40699636c4973a021627, scope.project.id=a2bcda48a2284783bfbb9edd5760b91b, user.id=3b89bcc775c24d8ea29d65328fddc1d4) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:52.430584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4210ab3-0cdd-4669-bd7e-e19a4fe0d1c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:52.432008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4210ab3-0cdd-4669-bd7e-e19a4fe0d1c9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:52.437615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 580/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:52 2022] GET /identity/v3/role_assignments?user.id=3b89bcc775c24d8ea29d65328fddc1d4&scope.project.id=a2bcda48a2284783bfbb9edd5760b91b&role.id=1be9be19909c40699636c4973a021627 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:54.488448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a3ae-e99c-40ff-9c48-6497abf22e52 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:54.489050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a3ae-e99c-40ff-9c48-6497abf22e52 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:54.489050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a3ae-e99c-40ff-9c48-6497abf22e52 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:54.490414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 551/1131] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:54.496197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d0ae-56bc-4866-bf9a-24c98c4a633a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:54.496628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d0ae-56bc-4866-bf9a-24c98c4a633a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:54.496752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d0ae-56bc-4866-bf9a-24c98c4a633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:54.513332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5701d0ae-56bc-4866-bf9a-24c98c4a633a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:54.514522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5701d0ae-56bc-4866-bf9a-24c98c4a633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:54.562183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:54.579696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 581/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:54.603409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a3ae-e99c-40ff-9c48-6497abf22e52 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:54.692989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:54.703503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a3ae-e99c-40ff-9c48-6497abf22e52 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:54.737690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ed7e-f604-4d20-a33f-14f2e76fd4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:54.738519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ed7e-f604-4d20-a33f-14f2e76fd4fe None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:54.738753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ed7e-f604-4d20-a33f-14f2e76fd4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:54.739025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ed7e-f604-4d20-a33f-14f2e76fd4fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:54.740185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266ed7e-f604-4d20-a33f-14f2e76fd4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:54.741650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266ed7e-f604-4d20-a33f-14f2e76fd4fe None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:54.743499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 552/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:54.749395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d0ae-56bc-4866-bf9a-24c98c4a633a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:54.844719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d0ae-56bc-4866-bf9a-24c98c4a633a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:54.878240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8de89-bd93-4053-be40-3bf01477a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:54.878887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8de89-bd93-4053-be40-3bf01477a236 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:54.879171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8de89-bd93-4053-be40-3bf01477a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:54.879452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8de89-bd93-4053-be40-3bf01477a236 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:54.880249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8de89-bd93-4053-be40-3bf01477a236 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:54.881710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8de89-bd93-4053-be40-3bf01477a236 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:54.908414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 582/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:54 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:56.977037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8901-f056-4e51-aa94-490fbf60b266 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:56.977556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8901-f056-4e51-aa94-490fbf60b266 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:56.977556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8901-f056-4e51-aa94-490fbf60b266 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:56.978895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 553/1135] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:56.984258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a944-e521-42ea-ad89-020961020099 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:56.984697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a944-e521-42ea-ad89-020961020099 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:56.984837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a944-e521-42ea-ad89-020961020099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.004009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a748a944-e521-42ea-ad89-020961020099 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:57.005218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a748a944-e521-42ea-ad89-020961020099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:57.034495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:57.072528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 583/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:57.098298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c8901-f056-4e51-aa94-490fbf60b266 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:57.196899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c8901-f056-4e51-aa94-490fbf60b266 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:57.230226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1f0a1-97c7-4408-a7df-619cc7fc81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:57.230944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1f0a1-97c7-4408-a7df-619cc7fc81c5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.231234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1f0a1-97c7-4408-a7df-619cc7fc81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.231519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1f0a1-97c7-4408-a7df-619cc7fc81c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.232687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1f0a1-97c7-4408-a7df-619cc7fc81c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:57.234230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1f0a1-97c7-4408-a7df-619cc7fc81c5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:57.235849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 554/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:57.241499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a944-e521-42ea-ad89-020961020099 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:57.336759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a944-e521-42ea-ad89-020961020099 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:57.371260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa638605-f962-438c-91fc-50385f305e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:57.371916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638605-f962-438c-91fc-50385f305e84 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.372205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638605-f962-438c-91fc-50385f305e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.372485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa638605-f962-438c-91fc-50385f305e84 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.373245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa638605-f962-438c-91fc-50385f305e84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:57.374743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa638605-f962-438c-91fc-50385f305e84 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:57.395384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 584/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:06:57 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:59.455319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8b58d-def0-412a-8772-5c98586d8268 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:59.455886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8b58d-def0-412a-8772-5c98586d8268 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:59.455886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8b58d-def0-412a-8772-5c98586d8268 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:59.457253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 555/1139] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:59.462370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259de5eb-ab14-43ad-96f2-c2c2c462e97c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:59.462756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259de5eb-ab14-43ad-96f2-c2c2c462e97c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:59.462943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259de5eb-ab14-43ad-96f2-c2c2c462e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:59.480154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-259de5eb-ab14-43ad-96f2-c2c2c462e97c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:59.481379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-259de5eb-ab14-43ad-96f2-c2c2c462e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:59.497730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:59.548065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 585/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:59.570999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8b58d-def0-412a-8772-5c98586d8268 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:59.598726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:59.671881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8b58d-def0-412a-8772-5c98586d8268 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:59.706331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:59.707047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:59.707330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:59.707610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:59.717372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:59.725032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:59.726223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:06:59.727166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 556/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:59.732296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259de5eb-ab14-43ad-96f2-c2c2c462e97c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:59.828183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259de5eb-ab14-43ad-96f2-c2c2c462e97c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:59.861329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:59.861990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:59.862274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:59.862555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:59.863295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:59.863605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:59.864998 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:59.873130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 586/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:59.879291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:59.961539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:59.975989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661886b-59d5-48db-8712-b26e266a58a3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.009055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.009901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.010184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.010463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] PATH_INFO: `/v3/users/36b18d84636d4eb596724b83eaad8c9e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.022971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] RBAC: Authorizing `identity:get_user(user_id=36b18d84636d4eb596724b83eaad8c9e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:00.024402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:00.026023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 557/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:59 2022] GET /identity/v3/users/36b18d84636d4eb596724b83eaad8c9e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:00.031698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:00.047622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:00.130260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211de2c-f5fa-469b-b6bb-55a703e413fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.161996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.162633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.162916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.163197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.228080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:00.229483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:00.243806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:00.327737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 587/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:07:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:07:00.333998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:00.432592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae73cd-3cae-491d-a35f-1b8ddd00a161 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.465540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a21f-675e-4a4f-9ce0-4f541f48f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.466383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a21f-675e-4a4f-9ce0-4f541f48f20e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.466665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a21f-675e-4a4f-9ce0-4f541f48f20e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.466939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a21f-675e-4a4f-9ce0-4f541f48f20e None admin] PATH_INFO: `/v3/projects/f34855b75dd044e3802d1b7987ea062a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.468090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a21f-675e-4a4f-9ce0-4f541f48f20e None admin] RBAC: Authorizing `identity:get_project(project_id=f34855b75dd044e3802d1b7987ea062a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:00.469551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a21f-675e-4a4f-9ce0-4f541f48f20e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:00.472097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 558/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:00 2022] GET /identity/v3/projects/f34855b75dd044e3802d1b7987ea062a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:00.478192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:00.573928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d462-2723-4666-a747-b254169dc6f5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.587296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:00.607549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b863447-fa88-4706-8d2a-edb4bd883ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.608196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b863447-fa88-4706-8d2a-edb4bd883ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.608482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b863447-fa88-4706-8d2a-edb4bd883ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.608766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b863447-fa88-4706-8d2a-edb4bd883ad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.609617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b863447-fa88-4706-8d2a-edb4bd883ad5 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=f34855b75dd044e3802d1b7987ea062a, user.id=36b18d84636d4eb596724b83eaad8c9e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:00.609930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b863447-fa88-4706-8d2a-edb4bd883ad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:00.612032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b863447-fa88-4706-8d2a-edb4bd883ad5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:00.617604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 588/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:07:00 2022] GET /identity/v3/role_assignments?user.id=36b18d84636d4eb596724b83eaad8c9e&scope.project.id=f34855b75dd044e3802d1b7987ea062a&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:02.632889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e945e-49bb-472c-ac8d-a954f40d5ffb None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:02.633425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e945e-49bb-472c-ac8d-a954f40d5ffb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:02.633544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e945e-49bb-472c-ac8d-a954f40d5ffb None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:02.634806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 559/1147] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:02.639943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e762af8-74ec-4363-bf2d-c7022adcda05 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:02.640356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e762af8-74ec-4363-bf2d-c7022adcda05 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:02.640500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e762af8-74ec-4363-bf2d-c7022adcda05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:02.657652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4e762af8-74ec-4363-bf2d-c7022adcda05 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:02.658908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4e762af8-74ec-4363-bf2d-c7022adcda05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:02.724353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 589/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:02.747171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e945e-49bb-472c-ac8d-a954f40d5ffb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:02.762085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:02.846572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e945e-49bb-472c-ac8d-a954f40d5ffb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:02.879736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:02.880515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:02.880797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:02.881105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:02.891028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:07:02.899836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:02.900996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:07:02.901892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 560/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:02.906907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e762af8-74ec-4363-bf2d-c7022adcda05 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.003769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e762af8-74ec-4363-bf2d-c7022adcda05 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.012798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:03.036897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.037557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.037842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.038121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.038864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:03.039173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:03.040539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:03.049027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 590/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:07:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:03.054732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.123569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:03.153015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1b040-f9e2-4435-a8c0-dd87ec7bc35d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.185767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.186621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.186928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.187201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] PATH_INFO: `/v3/users/36b18d84636d4eb596724b83eaad8c9e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.188368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] RBAC: Authorizing `identity:get_user(user_id=36b18d84636d4eb596724b83eaad8c9e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:03.190412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:03.191997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 561/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:07:03 2022] GET /identity/v3/users/36b18d84636d4eb596724b83eaad8c9e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:03.197781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.293786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44f06-2d67-487b-a218-c1347ac48e14 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.326525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc9d87-798e-4d25-beb6-986c0525d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.327368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9d87-798e-4d25-beb6-986c0525d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.327652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9d87-798e-4d25-beb6-986c0525d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.327931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9d87-798e-4d25-beb6-986c0525d0a6 None admin] PATH_INFO: `/v3/projects/f34855b75dd044e3802d1b7987ea062a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.329116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc9d87-798e-4d25-beb6-986c0525d0a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f34855b75dd044e3802d1b7987ea062a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:03.330579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc9d87-798e-4d25-beb6-986c0525d0a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:03.332242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 591/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:03 2022] GET /identity/v3/projects/f34855b75dd044e3802d1b7987ea062a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:03.338047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.436774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e296b1-dc35-4070-966e-3a72867df607 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.469076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9457aa7-222d-40d1-90ac-326c6d49a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.469957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457aa7-222d-40d1-90ac-326c6d49a43d None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.470791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457aa7-222d-40d1-90ac-326c6d49a43d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.471071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9457aa7-222d-40d1-90ac-326c6d49a43d None admin] PATH_INFO: `/v3/projects/f34855b75dd044e3802d1b7987ea062a/users/36b18d84636d4eb596724b83eaad8c9e/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.473057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9457aa7-222d-40d1-90ac-326c6d49a43d None admin] RBAC: Authorizing `identity:create_grant(project_id=f34855b75dd044e3802d1b7987ea062a, user_id=36b18d84636d4eb596724b83eaad8c9e, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:03.474494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9457aa7-222d-40d1-90ac-326c6d49a43d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:03.483254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:03.488741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 562/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:07:03 2022] PUT /identity/v3/projects/f34855b75dd044e3802d1b7987ea062a/users/36b18d84636d4eb596724b83eaad8c9e/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:07:05.472391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b2111-3590-4ea1-8cbf-75d78dbafee0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:05.472951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b2111-3590-4ea1-8cbf-75d78dbafee0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:05.473039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b2111-3590-4ea1-8cbf-75d78dbafee0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:05.474357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 592/1154] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:05.479445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d0a59-ff71-42f7-a334-3d91b94f1ab7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:05.479871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d0a59-ff71-42f7-a334-3d91b94f1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:05.480018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d0a59-ff71-42f7-a334-3d91b94f1ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:05.497339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4a9d0a59-ff71-42f7-a334-3d91b94f1ab7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:05.498515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a9d0a59-ff71-42f7-a334-3d91b94f1ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:05.562276 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 563/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:05.586224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b2111-3590-4ea1-8cbf-75d78dbafee0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:05.625523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:05.685533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b2111-3590-4ea1-8cbf-75d78dbafee0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:05.718359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:05.719138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:05.719419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:05.719692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:05.729624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:07:05.737325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:05.738433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:07:05.739327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 593/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:07:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:05.744688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d0a59-ff71-42f7-a334-3d91b94f1ab7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:05.840520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d0a59-ff71-42f7-a334-3d91b94f1ab7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:05.868217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:05.874208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:05.874860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:05.875142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:05.875421 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:05.876183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:05.876488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:05.878557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:05.886520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 564/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:07:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:05.892141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:05.985651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:05.990611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e8fd-8aa8-4fb9-a269-844979c17df6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:06.023675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:06.024531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:06.024841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:06.025121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] PATH_INFO: `/v3/users/36b18d84636d4eb596724b83eaad8c9e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:06.026284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] RBAC: Authorizing `identity:get_user(user_id=36b18d84636d4eb596724b83eaad8c9e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:06.027709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:06.029355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 594/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:07:05 2022] GET /identity/v3/users/36b18d84636d4eb596724b83eaad8c9e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:06.035057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:06.132741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e79468-c4ff-4880-a907-edc586a48955 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:06.164656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:06.165314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:06.165602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:06.165883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:06.221973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:06.231607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:06.233091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:06.328568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 565/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:07:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:07:06.334382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:06.432408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced13ee-27c1-4a81-9f25-e4c12d7084d3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:06.464341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e856ad8-4ef7-4bdf-b124-d0af865d853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:06.465227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e856ad8-4ef7-4bdf-b124-d0af865d853b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:06.465519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e856ad8-4ef7-4bdf-b124-d0af865d853b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:06.465801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e856ad8-4ef7-4bdf-b124-d0af865d853b None admin] PATH_INFO: `/v3/projects/f34855b75dd044e3802d1b7987ea062a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:06.467086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e856ad8-4ef7-4bdf-b124-d0af865d853b None admin] RBAC: Authorizing `identity:get_project(project_id=f34855b75dd044e3802d1b7987ea062a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:06.468710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e856ad8-4ef7-4bdf-b124-d0af865d853b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:06.470464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 595/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:06 2022] GET /identity/v3/projects/f34855b75dd044e3802d1b7987ea062a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:06.477072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:06.565992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:06.575222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972a39d-6952-4f56-a22c-cd9771f2af3f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:06.608312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e622f47-6a4e-41a2-91f6-53ff14ad79d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:06.608932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e622f47-6a4e-41a2-91f6-53ff14ad79d7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:06.609225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e622f47-6a4e-41a2-91f6-53ff14ad79d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:06.609506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e622f47-6a4e-41a2-91f6-53ff14ad79d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:06.610331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e622f47-6a4e-41a2-91f6-53ff14ad79d7 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=f34855b75dd044e3802d1b7987ea062a, user.id=36b18d84636d4eb596724b83eaad8c9e) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:06.610685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e622f47-6a4e-41a2-91f6-53ff14ad79d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:06.612763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e622f47-6a4e-41a2-91f6-53ff14ad79d7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:06.618742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 566/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:07:06 2022] GET /identity/v3/role_assignments?user.id=36b18d84636d4eb596724b83eaad8c9e&scope.project.id=f34855b75dd044e3802d1b7987ea062a&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:08.652797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87727687-0012-41c0-b91a-ed4eb5454f19 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:08.653378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87727687-0012-41c0-b91a-ed4eb5454f19 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:08.653378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87727687-0012-41c0-b91a-ed4eb5454f19 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:08.654755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 596/1162] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:08.660184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b098c-809d-4a7c-9a5b-a27ad97faed7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:08.660600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b098c-809d-4a7c-9a5b-a27ad97faed7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:08.660745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b098c-809d-4a7c-9a5b-a27ad97faed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:08.677233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-459b098c-809d-4a7c-9a5b-a27ad97faed7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:08.678406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-459b098c-809d-4a7c-9a5b-a27ad97faed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:08.744777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 567/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:08.767499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87727687-0012-41c0-b91a-ed4eb5454f19 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:08.802959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:08.868752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87727687-0012-41c0-b91a-ed4eb5454f19 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:08.903139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:08.903717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:08.904003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:08.904284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:08.968208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:08.969681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:09.001680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:09.068345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 597/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:07:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:07:09.074226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b098c-809d-4a7c-9a5b-a27ad97faed7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:09.156486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:09.171898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b098c-809d-4a7c-9a5b-a27ad97faed7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:09.206088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab5754-45ab-4524-bdb2-d90dfb1f4539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:09.206861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5754-45ab-4524-bdb2-d90dfb1f4539 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:09.207149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5754-45ab-4524-bdb2-d90dfb1f4539 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:09.207424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5754-45ab-4524-bdb2-d90dfb1f4539 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:09.213981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab5754-45ab-4524-bdb2-d90dfb1f4539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:09.215414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab5754-45ab-4524-bdb2-d90dfb1f4539 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f6ab5754-45ab-4524-bdb2-d90dfb1f4539 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:09.229908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:09.231182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:07:09.232260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 568/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:07:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:09.237421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:09.332671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a17852-fd7a-43c0-8258-b38cbe83fb36 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:09.365754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5de42-ff5c-4782-b1e2-a49b2cd2c57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:09.366398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5de42-ff5c-4782-b1e2-a49b2cd2c57f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:09.366680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5de42-ff5c-4782-b1e2-a49b2cd2c57f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:09.366958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5de42-ff5c-4782-b1e2-a49b2cd2c57f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:09.367921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5de42-ff5c-4782-b1e2-a49b2cd2c57f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:09.368231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5de42-ff5c-4782-b1e2-a49b2cd2c57f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:09.369619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5de42-ff5c-4782-b1e2-a49b2cd2c57f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:09.371056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:09.377708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 598/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Jul 21 04:07:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:11.418699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cb377-2b79-435a-8ec0-fc2873d8cecf None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:11.419280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cb377-2b79-435a-8ec0-fc2873d8cecf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:11.419280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cb377-2b79-435a-8ec0-fc2873d8cecf None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:11.420608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 569/1167] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:11.426707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06268-c10d-42d3-9362-65e6dfca81a9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:11.427125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06268-c10d-42d3-9362-65e6dfca81a9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:11.427273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06268-c10d-42d3-9362-65e6dfca81a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:11.444205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f7b06268-c10d-42d3-9362-65e6dfca81a9 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:11.445417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f7b06268-c10d-42d3-9362-65e6dfca81a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:11.510330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 599/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:11.532770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cb377-2b79-435a-8ec0-fc2873d8cecf None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:11.632944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cb377-2b79-435a-8ec0-fc2873d8cecf None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:11.666270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189143-cccb-482f-8f07-f692ee047197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:11.666932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189143-cccb-482f-8f07-f692ee047197 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:11.667219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189143-cccb-482f-8f07-f692ee047197 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:11.667501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189143-cccb-482f-8f07-f692ee047197 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:11.668259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189143-cccb-482f-8f07-f692ee047197 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:11.669980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189143-cccb-482f-8f07-f692ee047197 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:11.684681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 570/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Thu Jul 21 04:07:11 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:07:13.732181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edbd49-8846-4ca6-ab08-a780331358ef None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:13.732650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edbd49-8846-4ca6-ab08-a780331358ef None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:13.732743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edbd49-8846-4ca6-ab08-a780331358ef None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:13.734148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 600/1170] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:13.739865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dddc6-9182-4396-b525-449c11573ac6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:13.740265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dddc6-9182-4396-b525-449c11573ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:13.740423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dddc6-9182-4396-b525-449c11573ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:13.752805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:13.758575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-249dddc6-9182-4396-b525-449c11573ac6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:13.759761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-249dddc6-9182-4396-b525-449c11573ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:13.825009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 571/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:13.849298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edbd49-8846-4ca6-ab08-a780331358ef None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:13.948965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edbd49-8846-4ca6-ab08-a780331358ef None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:13.975184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:13.983215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0c6d2-982f-4aff-b251-be8527d9a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:13.984069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0c6d2-982f-4aff-b251-be8527d9a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:13.984357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0c6d2-982f-4aff-b251-be8527d9a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:13.984639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0c6d2-982f-4aff-b251-be8527d9a2cf None admin] PATH_INFO: `/v3/domains/fdd0bc831559423e929914624691c99f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:13.995265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0c6d2-982f-4aff-b251-be8527d9a2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=fdd0bc831559423e929914624691c99f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:13.996710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0c6d2-982f-4aff-b251-be8527d9a2cf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:13.998357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 601/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Jul 21 04:07:13 2022] GET /identity/v3/domains/fdd0bc831559423e929914624691c99f => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:14.004787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dddc6-9182-4396-b525-449c11573ac6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:14.100052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dddc6-9182-4396-b525-449c11573ac6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:14.133294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358aa35-44f0-4509-9b46-595eca1d88fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:14.133939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358aa35-44f0-4509-9b46-595eca1d88fc None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:14.134226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358aa35-44f0-4509-9b46-595eca1d88fc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:14.134505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358aa35-44f0-4509-9b46-595eca1d88fc None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:14.135200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358aa35-44f0-4509-9b46-595eca1d88fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:14.136627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358aa35-44f0-4509-9b46-595eca1d88fc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:14.140571 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:14.162005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 572/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:07:14 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:07:16.221801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0630d-f256-4e5f-ac96-e38099d29bab None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:16.222344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0630d-f256-4e5f-ac96-e38099d29bab None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:16.222344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0630d-f256-4e5f-ac96-e38099d29bab None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:16.223722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 602/1174] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:16.229043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1706-1415-40ae-b6d2-36d34e337ff6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:16.229467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1706-1415-40ae-b6d2-36d34e337ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:16.229601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c1706-1415-40ae-b6d2-36d34e337ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:16.246896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c77c1706-1415-40ae-b6d2-36d34e337ff6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:16.248080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c77c1706-1415-40ae-b6d2-36d34e337ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:16.312174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 573/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:16.336380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0630d-f256-4e5f-ac96-e38099d29bab None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:16.438244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0630d-f256-4e5f-ac96-e38099d29bab None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:16.471676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461106e8-ecc5-42e1-baf9-c67ea1407374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:16.472557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461106e8-ecc5-42e1-baf9-c67ea1407374 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:16.472798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461106e8-ecc5-42e1-baf9-c67ea1407374 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:16.473109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461106e8-ecc5-42e1-baf9-c67ea1407374 None admin] PATH_INFO: `/v3/domains/fdd0bc831559423e929914624691c99f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:16.474276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461106e8-ecc5-42e1-baf9-c67ea1407374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fdd0bc831559423e929914624691c99f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:16.475719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461106e8-ecc5-42e1-baf9-c67ea1407374 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:16.477343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 603/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Jul 21 04:07:16 2022] GET /identity/v3/domains/fdd0bc831559423e929914624691c99f => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:16.483042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1706-1415-40ae-b6d2-36d34e337ff6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:16.580576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c1706-1415-40ae-b6d2-36d34e337ff6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:16.598078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:16.615331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865811dd-6b43-4018-86ab-f05fde216b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:16.615987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865811dd-6b43-4018-86ab-f05fde216b79 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:16.616269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865811dd-6b43-4018-86ab-f05fde216b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:16.616545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865811dd-6b43-4018-86ab-f05fde216b79 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:16.617547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865811dd-6b43-4018-86ab-f05fde216b79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:16.618979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865811dd-6b43-4018-86ab-f05fde216b79 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:16.639113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 574/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:07:16 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:07:18.707493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e7a74-e09a-4164-b658-170e407fcc0c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:18.707968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e7a74-e09a-4164-b658-170e407fcc0c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:18.708071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e7a74-e09a-4164-b658-170e407fcc0c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:18.709448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 604/1178] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:18.714535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2dfb-d2c2-4ad2-a6ab-7e9d916ab828 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:18.714922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2dfb-d2c2-4ad2-a6ab-7e9d916ab828 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:18.715112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2dfb-d2c2-4ad2-a6ab-7e9d916ab828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:18.731451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-178e2dfb-d2c2-4ad2-a6ab-7e9d916ab828 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:18.732636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-178e2dfb-d2c2-4ad2-a6ab-7e9d916ab828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:18.797642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 575/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:18.821425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e7a74-e09a-4164-b658-170e407fcc0c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:18.877857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:18.920219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e7a74-e09a-4164-b658-170e407fcc0c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:18.953606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:18.954375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:18.954804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:18.955268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:18.965040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:07:18.972892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:18.974073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:07:18.975395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 605/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:18.980013 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e2dfb-d2c2-4ad2-a6ab-7e9d916ab828 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:19.076745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e2dfb-d2c2-4ad2-a6ab-7e9d916ab828 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:19.079012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:19.113073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:19.113731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:19.114021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:19.114302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:19.115042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:19.115353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:19.116725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:19.124837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 576/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:19.130842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:19.228936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6834b8-dd7a-49df-a0c0-d7f0823617e8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:19.245231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:19.264214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0371-f155-4419-a859-7aa36603485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:19.265094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0371-f155-4419-a859-7aa36603485f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:19.265376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0371-f155-4419-a859-7aa36603485f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:19.265653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0371-f155-4419-a859-7aa36603485f None admin] PATH_INFO: `/v3/users/1f78caf161c646c08a4456fdfb429ea2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:19.278509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0371-f155-4419-a859-7aa36603485f None admin] RBAC: Authorizing `identity:get_user(user_id=1f78caf161c646c08a4456fdfb429ea2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:19.279953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0371-f155-4419-a859-7aa36603485f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:19.281672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 606/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:07:19 2022] GET /identity/v3/users/1f78caf161c646c08a4456fdfb429ea2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:19.288094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:19.386857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea255b-09b7-4976-b5e0-422d624c25f3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:19.419352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:19.419996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:19.420283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:19.420562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:19.452780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:19.487233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:19.488619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:19.583098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 577/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:07:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:07:19.589009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0371-f155-4419-a859-7aa36603485f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:19.686751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0371-f155-4419-a859-7aa36603485f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:19.719512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01de3e-71f6-4ecf-bc4c-bd98e58b3d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:19.721007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01de3e-71f6-4ecf-bc4c-bd98e58b3d36 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:19.721287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01de3e-71f6-4ecf-bc4c-bd98e58b3d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:19.721565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01de3e-71f6-4ecf-bc4c-bd98e58b3d36 None admin] PATH_INFO: `/v3/projects/e4485fb6f3814b748aab8d5c289f3e99` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:19.722728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01de3e-71f6-4ecf-bc4c-bd98e58b3d36 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485fb6f3814b748aab8d5c289f3e99)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:19.724165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01de3e-71f6-4ecf-bc4c-bd98e58b3d36 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:19.725887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 607/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:19 2022] GET /identity/v3/projects/e4485fb6f3814b748aab8d5c289f3e99 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:19.731953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:19.796369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:19.831441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c038c-b1c2-45e2-83f5-916ebe255d70 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:19.864259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165693f-dc43-45fd-b561-48b5386e72d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:19.864929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165693f-dc43-45fd-b561-48b5386e72d1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:19.865223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165693f-dc43-45fd-b561-48b5386e72d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:19.865504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165693f-dc43-45fd-b561-48b5386e72d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:19.866323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165693f-dc43-45fd-b561-48b5386e72d1 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=e4485fb6f3814b748aab8d5c289f3e99, user.id=1f78caf161c646c08a4456fdfb429ea2) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:19.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165693f-dc43-45fd-b561-48b5386e72d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:19.868314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165693f-dc43-45fd-b561-48b5386e72d1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:19.873557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 578/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:07:19 2022] GET /identity/v3/role_assignments?user.id=1f78caf161c646c08a4456fdfb429ea2&scope.project.id=e4485fb6f3814b748aab8d5c289f3e99&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:21.870408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c85719-a012-429c-b72c-da39144eb010 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:21.870930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c85719-a012-429c-b72c-da39144eb010 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:21.870930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c85719-a012-429c-b72c-da39144eb010 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:21.872323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 608/1186] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:21.877520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec917a-b4c7-4b30-abf8-bef72294cd9e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:21.877982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec917a-b4c7-4b30-abf8-bef72294cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:21.878088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec917a-b4c7-4b30-abf8-bef72294cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:21.894957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-51ec917a-b4c7-4b30-abf8-bef72294cd9e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:21.896151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51ec917a-b4c7-4b30-abf8-bef72294cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:21.960836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 579/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:21.983611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c85719-a012-429c-b72c-da39144eb010 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:22.027048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:22.084030 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c85719-a012-429c-b72c-da39144eb010 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:22.116091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:22.117157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:22.117448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:22.117728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:22.128525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:07:22.136168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:22.137321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:07:22.138375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 609/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:07:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:22.143964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec917a-b4c7-4b30-abf8-bef72294cd9e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:22.200967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:22.240234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec917a-b4c7-4b30-abf8-bef72294cd9e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:22.275149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:22.275802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:22.276090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:22.276371 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:22.277149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:22.277461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:22.278838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:22.286871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 580/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:07:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:22.292772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:22.390422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11450f-0376-4340-8d8d-700e7ef3b1d4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:22.392605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:22.424587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:22.425467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:22.425756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:22.426038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] PATH_INFO: `/v3/users/1f78caf161c646c08a4456fdfb429ea2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:22.427218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] RBAC: Authorizing `identity:get_user(user_id=1f78caf161c646c08a4456fdfb429ea2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:22.428655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:22.430309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 610/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:07:22 2022] GET /identity/v3/users/1f78caf161c646c08a4456fdfb429ea2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:22.436479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:22.534802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992e9f9-ab21-4b55-803a-c34e7d3fa286 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:22.556552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:22.568597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60ea1-d641-42ea-81b1-f47599bae2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:22.569475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60ea1-d641-42ea-81b1-f47599bae2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:22.569768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60ea1-d641-42ea-81b1-f47599bae2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:22.570052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60ea1-d641-42ea-81b1-f47599bae2a2 None admin] PATH_INFO: `/v3/projects/e4485fb6f3814b748aab8d5c289f3e99` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:22.571223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60ea1-d641-42ea-81b1-f47599bae2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485fb6f3814b748aab8d5c289f3e99)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:22.572659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60ea1-d641-42ea-81b1-f47599bae2a2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:22.574359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 581/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:22 2022] GET /identity/v3/projects/e4485fb6f3814b748aab8d5c289f3e99 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:22.580433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:22.677932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031658a-8382-40d3-a19a-cbaa1837649c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:22.710409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b5288-90aa-43f7-b72d-81b151672496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:22.711314 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5288-90aa-43f7-b72d-81b151672496 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:22.711595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5288-90aa-43f7-b72d-81b151672496 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:22.711873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5288-90aa-43f7-b72d-81b151672496 None admin] PATH_INFO: `/v3/projects/e4485fb6f3814b748aab8d5c289f3e99/users/1f78caf161c646c08a4456fdfb429ea2/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:22.713815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b5288-90aa-43f7-b72d-81b151672496 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4485fb6f3814b748aab8d5c289f3e99, user_id=1f78caf161c646c08a4456fdfb429ea2, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:22.715236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b5288-90aa-43f7-b72d-81b151672496 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:22.727603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 611/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:07:22 2022] PUT /identity/v3/projects/e4485fb6f3814b748aab8d5c289f3e99/users/1f78caf161c646c08a4456fdfb429ea2/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:07:24.897693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca190fc5-7a0c-4392-914a-4cca1ba0fa17 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:24.898235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca190fc5-7a0c-4392-914a-4cca1ba0fa17 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:24.898235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca190fc5-7a0c-4392-914a-4cca1ba0fa17 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:24.899612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 582/1193] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:24.904853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae489b1-c7ec-491a-9b4d-05c22d18cae2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:24.905260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae489b1-c7ec-491a-9b4d-05c22d18cae2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:24.905421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae489b1-c7ec-491a-9b4d-05c22d18cae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:24.922605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7ae489b1-c7ec-491a-9b4d-05c22d18cae2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:24.923752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ae489b1-c7ec-491a-9b4d-05c22d18cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:24.946291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:24.990426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 612/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:25.013680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca190fc5-7a0c-4392-914a-4cca1ba0fa17 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:25.113710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca190fc5-7a0c-4392-914a-4cca1ba0fa17 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:25.146781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:25.147552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:25.147833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:25.148109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:25.157802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:07:25.165390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:25.166528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:07:25.167417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 583/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:07:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:25.172392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae489b1-c7ec-491a-9b4d-05c22d18cae2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:25.270325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae489b1-c7ec-491a-9b4d-05c22d18cae2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:25.302909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:25.303564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:25.303849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:25.304129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:25.304893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:25.305202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:25.306577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:25.315100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 613/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:25.320691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:25.370109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:25.419742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55517b99-bb76-4fec-a6ba-526307d50686 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:25.452402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:25.453291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:25.453579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:25.453857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] PATH_INFO: `/v3/users/1f78caf161c646c08a4456fdfb429ea2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:25.455769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] RBAC: Authorizing `identity:get_user(user_id=1f78caf161c646c08a4456fdfb429ea2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:25.457256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:25.458889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 584/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Jul 21 04:07:25 2022] GET /identity/v3/users/1f78caf161c646c08a4456fdfb429ea2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:25.464684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:25.489243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:25.562240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c29fb-3543-4d3b-a0df-66515030c21d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:25.594100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:25.594756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:25.595047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:25.595330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:25.659842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:25.661338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:25.684196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:25.760058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 614/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:07:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:07:25.765890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:25.865505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f9f51-0e46-4ade-86b6-4c061cdb676e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:25.881994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:25.899052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01438a62-a181-4736-a550-cfd737c56acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:25.899901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01438a62-a181-4736-a550-cfd737c56acd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:25.900183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01438a62-a181-4736-a550-cfd737c56acd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:25.900458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01438a62-a181-4736-a550-cfd737c56acd None admin] PATH_INFO: `/v3/projects/e4485fb6f3814b748aab8d5c289f3e99` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:25.901640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01438a62-a181-4736-a550-cfd737c56acd None admin] RBAC: Authorizing `identity:get_project(project_id=e4485fb6f3814b748aab8d5c289f3e99)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:25.903059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01438a62-a181-4736-a550-cfd737c56acd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:25.904707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 585/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:25 2022] GET /identity/v3/projects/e4485fb6f3814b748aab8d5c289f3e99 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:25.911330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:26.006303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0b219-a0d8-4743-bb6e-987383577e2f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:26.027830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:26.039898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5e585-793f-4004-9a0c-514ff78cdf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:26.040536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5e585-793f-4004-9a0c-514ff78cdf92 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:26.040838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5e585-793f-4004-9a0c-514ff78cdf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:26.041124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5e585-793f-4004-9a0c-514ff78cdf92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:26.041942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5e585-793f-4004-9a0c-514ff78cdf92 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=e4485fb6f3814b748aab8d5c289f3e99, user.id=1f78caf161c646c08a4456fdfb429ea2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:26.042254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5e585-793f-4004-9a0c-514ff78cdf92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:26.043672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5e585-793f-4004-9a0c-514ff78cdf92 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:26.050085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 615/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:07:25 2022] GET /identity/v3/role_assignments?user.id=1f78caf161c646c08a4456fdfb429ea2&scope.project.id=e4485fb6f3814b748aab8d5c289f3e99&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:35.895036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:36.046738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.354414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda3237-fe65-4b49-a973-15abb9bc7c9d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.355025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda3237-fe65-4b49-a973-15abb9bc7c9d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.355025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda3237-fe65-4b49-a973-15abb9bc7c9d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.356370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 586/1201] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:21.364399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ff75-8f99-408f-a4ea-dc4cfd4ef8a5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.364399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ff75-8f99-408f-a4ea-dc4cfd4ef8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.364399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ff75-8f99-408f-a4ea-dc4cfd4ef8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.387330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c9e3ff75-8f99-408f-a4ea-dc4cfd4ef8a5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:21.388901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c9e3ff75-8f99-408f-a4ea-dc4cfd4ef8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:21.471866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 616/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:21.498391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda3237-fe65-4b49-a973-15abb9bc7c9d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.649944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda3237-fe65-4b49-a973-15abb9bc7c9d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.708542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.709533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.709830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.710172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.726076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:21.728045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:21.755388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:21.756502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:21.757521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:21.757521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:21.757521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:21.757521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:21.761718 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 587/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:21.765012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3ff75-8f99-408f-a4ea-dc4cfd4ef8a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.912559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3ff75-8f99-408f-a4ea-dc4cfd4ef8a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.963436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.965600 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248854a0-97da-4f96-ba2b-f4e5b67630e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.966323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248854a0-97da-4f96-ba2b-f4e5b67630e6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.966613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248854a0-97da-4f96-ba2b-f4e5b67630e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.966942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248854a0-97da-4f96-ba2b-f4e5b67630e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.968332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248854a0-97da-4f96-ba2b-f4e5b67630e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:21.968669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248854a0-97da-4f96-ba2b-f4e5b67630e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:21.970282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248854a0-97da-4f96-ba2b-f4e5b67630e6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:21.983732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 617/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:21.990185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:22.073506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:22.158468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895e59a-51b4-4514-bc74-ddf7852c2dec None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:22.202823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be19cd-9976-4cfc-85a8-a4bf18d04094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:22.203513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be19cd-9976-4cfc-85a8-a4bf18d04094 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:22.203795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be19cd-9976-4cfc-85a8-a4bf18d04094 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:22.204114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be19cd-9976-4cfc-85a8-a4bf18d04094 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:22.204862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be19cd-9976-4cfc-85a8-a4bf18d04094 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:22.206674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be19cd-9976-4cfc-85a8-a4bf18d04094 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:22.235915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 588/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Jul 21 04:08:21 2022] POST /identity/v3/users => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:08:24.703829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8177aaa-b456-4d29-bd66-633ac1ae9de5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:24.704411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8177aaa-b456-4d29-bd66-633ac1ae9de5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:24.704561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8177aaa-b456-4d29-bd66-633ac1ae9de5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:24.706121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 618/1206] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:24.711833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1f7ad-1e2d-4b6c-a470-2803032f3d6c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:24.712482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1f7ad-1e2d-4b6c-a470-2803032f3d6c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:24.712482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1f7ad-1e2d-4b6c-a470-2803032f3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:24.733555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c2d1f7ad-1e2d-4b6c-a470-2803032f3d6c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:24.734916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2d1f7ad-1e2d-4b6c-a470-2803032f3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:24.821461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 589/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:24.847871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8177aaa-b456-4d29-bd66-633ac1ae9de5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:24.986399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8177aaa-b456-4d29-bd66-633ac1ae9de5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.031203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.032182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.032666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.033135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.046044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:25.054478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:25.055858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:25.057290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:25.060675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 619/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:08:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:25.062800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1f7ad-1e2d-4b6c-a470-2803032f3d6c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.111857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.192956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1f7ad-1e2d-4b6c-a470-2803032f3d6c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.237511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.238120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.238503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.238875 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.239767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:25.240086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.242066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.255918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 590/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:25.261514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.320658 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.380582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1fbb0-83dd-442b-8f0a-a0f9633b6232 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.426163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.426969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.427250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.427528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.439276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.440738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:25.462147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:25.463200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:25.464162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:25.464162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:25.464162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:25.464162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:25.469465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 620/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:25.470634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.586251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.590551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a92d-efd5-4e20-8a3c-1a132b0d1a03 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.628927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.629801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.630094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.630468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.631267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:25.631559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.633088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.646819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 591/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:25.653792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.770845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0319bf-7d40-476c-9095-f13e9baea2b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.773722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.810667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.812067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.812412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.812718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.823698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.825207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:25.843069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:25.844302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:25.845610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:25.850908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.851633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 621/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:25.977428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1854ec-12c9-4610-bc2e-86e78687858b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.023329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.024008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.024350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.024595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.025642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:26.025954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.027540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.054354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 592/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:26.060339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.204419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf6861-77a1-42f4-9fd2-f0a9458107ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.255119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.255804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.256091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.256394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.292225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.342268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.345219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.468072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 622/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:08:26.469940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.493569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.587021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befb97-548b-4206-9c28-6838bfd2f996 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.631689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.632812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.633129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.633501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.646127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.647754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:26.668069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:26.669110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:26.670076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:26.670076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:26.670076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:26.670076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:26.672996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 593/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:26.675560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.759204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.805915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7a4dc-f5c0-4b2a-8d58-77fef861acf6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.851358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.852099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.852415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.852700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.853456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:26.853766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.855202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.868237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 623/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:26.875140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.955716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.989834 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2fa1c-b522-471a-a72c-851c6a4e6677 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:27.031301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:27.032026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:27.032299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:27.032600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:27.040367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:27.041932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:27.057122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:27.058315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:27.064757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 594/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:27.066889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:27.174598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaed54-0107-4f37-b360-f6d546bbe073 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:27.197678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:27.210702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b2b7f-e0c6-40f7-9919-ad9e9dbf3b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:27.211465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2b7f-e0c6-40f7-9919-ad9e9dbf3b12 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:27.211817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2b7f-e0c6-40f7-9919-ad9e9dbf3b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:27.212165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2b7f-e0c6-40f7-9919-ad9e9dbf3b12 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:27.213056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b2b7f-e0c6-40f7-9919-ad9e9dbf3b12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:27.213435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b2b7f-e0c6-40f7-9919-ad9e9dbf3b12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:27.214939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b2b7f-e0c6-40f7-9919-ad9e9dbf3b12 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:27.228139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 624/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:27.235595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:27.360675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6247-84c1-4625-84c2-096088aa0f0d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:27.401021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:27.410973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044d676-75e2-4f7d-8ba6-6d701184e22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:27.411650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044d676-75e2-4f7d-8ba6-6d701184e22c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:27.411919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044d676-75e2-4f7d-8ba6-6d701184e22c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:27.412197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044d676-75e2-4f7d-8ba6-6d701184e22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:27.413052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044d676-75e2-4f7d-8ba6-6d701184e22c None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=3357f08257be47b58cf048c12daabfad) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:27.413365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044d676-75e2-4f7d-8ba6-6d701184e22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:27.414801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044d676-75e2-4f7d-8ba6-6d701184e22c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:27.422086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 595/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:27 2022] GET /identity/v3/role_assignments?user.id=3357f08257be47b58cf048c12daabfad&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:29.810277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfa6a-79de-4807-81e2-2a92c72531ec None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:29.810966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfa6a-79de-4807-81e2-2a92c72531ec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:29.811121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfa6a-79de-4807-81e2-2a92c72531ec None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:29.812522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 625/1220] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:29.818801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb371f4-51b3-4a47-8a74-2f816533b992 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:29.819259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb371f4-51b3-4a47-8a74-2f816533b992 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:29.819353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb371f4-51b3-4a47-8a74-2f816533b992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:29.835632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2eb371f4-51b3-4a47-8a74-2f816533b992 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:29.836871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2eb371f4-51b3-4a47-8a74-2f816533b992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:29.906843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 596/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:29.931637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dfa6a-79de-4807-81e2-2a92c72531ec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:30.038368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dfa6a-79de-4807-81e2-2a92c72531ec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:30.074001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:30.074917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:30.075244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:30.075570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:30.087378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:30.095139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:30.096306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:30.097700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 626/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:08:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:30.102418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb371f4-51b3-4a47-8a74-2f816533b992 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:30.204610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb371f4-51b3-4a47-8a74-2f816533b992 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:30.229345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:30.244353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:30.245052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:30.245344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:30.245629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:30.246380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:30.246696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:30.248075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:30.257807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 597/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:30.264846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:30.312963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:30.376464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708837b-9b81-4301-bd41-4b726bdcc1b8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:30.418854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:30.419964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:30.421525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:30.421909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:30.437588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:30.441912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:30.465436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:30.466484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:30.468094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:30.468094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:30.468094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:30.468094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:30.468094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 627/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:30.474875 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:30.592531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9987ea-5883-4f3e-9173-0c87fb3b8384 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:30.631714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:30.632548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:30.632911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:30.633246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:30.634017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:30.634384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:30.635980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:30.652871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 598/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:30.657575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:30.761777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:30.770670 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bcdca-045f-4879-a3bb-662f06e7bbb4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:30.807813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:30.808632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:30.809038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:30.809408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:30.818316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:30.820076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:30.835409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:30.836756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:30.838115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 628/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:30.843828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:30.901381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:30.969676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c925f-d6bc-4296-a32a-00468c95154c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:31.005574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:31.006372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.006657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.006978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.007885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:31.008251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:31.009955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:31.027978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 599/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:31.034979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:31.144482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415475e-4aea-4012-a0ef-97363e1088bb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:31.180968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:31.181758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.182042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.182317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.193816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:31.195496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:31.214095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:31.215220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:31.216322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:31.216322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:31.216322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:31.216322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:31.216322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 629/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:31.221395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:31.327444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ac9c-1122-4bec-b193-834d15931dac None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:31.329436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:31.364853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:31.365747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.366048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.366364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.367088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:31.367395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:31.368796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:31.385378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 600/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:31.392188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:31.401992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:31.504148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54dc9-1ebe-4f2a-9cad-b4ec19d2aec4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:31.539811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:31.540615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.540924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.541201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.550844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:31.552475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:31.567922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:31.569237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:31.570187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 630/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:31.575003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:31.688889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f373aa-86e5-4a96-a810-2e9766c83382 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:31.729437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7327-4791-4097-ba06-3d1c1cda9f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:31.730109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7327-4791-4097-ba06-3d1c1cda9f04 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.730410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7327-4791-4097-ba06-3d1c1cda9f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.730668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7327-4791-4097-ba06-3d1c1cda9f04 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.732251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7327-4791-4097-ba06-3d1c1cda9f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:31.732251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7327-4791-4097-ba06-3d1c1cda9f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:31.733904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7327-4791-4097-ba06-3d1c1cda9f04 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:31.746825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 601/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:31.753156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:31.822952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:31.862566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd23ac-b492-4b27-b81f-1f4c44d6aa8a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:31.899258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0f93b-f16d-43ae-9f7f-ce2b3ce7dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:31.900118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0f93b-f16d-43ae-9f7f-ce2b3ce7dded None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.900401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0f93b-f16d-43ae-9f7f-ce2b3ce7dded None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.900679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0f93b-f16d-43ae-9f7f-ce2b3ce7dded None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/3357f08257be47b58cf048c12daabfad/roles/4dcc6b65bf2143728b2d8ba9b04eadb7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.915760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0f93b-f16d-43ae-9f7f-ce2b3ce7dded None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=3357f08257be47b58cf048c12daabfad, role_id=4dcc6b65bf2143728b2d8ba9b04eadb7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:31.917374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0f93b-f16d-43ae-9f7f-ce2b3ce7dded None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:31.943143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 631/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:08:31 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/3357f08257be47b58cf048c12daabfad/roles/4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:08:34.084036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167199e-1ba7-46dd-870d-2e19f4efab51 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.084627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167199e-1ba7-46dd-870d-2e19f4efab51 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.084627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167199e-1ba7-46dd-870d-2e19f4efab51 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.085985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 602/1233] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:34.091978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb645-be7a-4ed4-9145-212966a965d6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.092590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb645-be7a-4ed4-9145-212966a965d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.092590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb645-be7a-4ed4-9145-212966a965d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.111191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-78ccb645-be7a-4ed4-9145-212966a965d6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:34.112395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-78ccb645-be7a-4ed4-9145-212966a965d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:34.189052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 632/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:34.214176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167199e-1ba7-46dd-870d-2e19f4efab51 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.241841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:34.329257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167199e-1ba7-46dd-870d-2e19f4efab51 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.368933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.369927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.370381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.370726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.384322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:34.394034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:34.395148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:34.396141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 603/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:34.402816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb645-be7a-4ed4-9145-212966a965d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.457472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:34.515937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb645-be7a-4ed4-9145-212966a965d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.553141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.553810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.554088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.554364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.555116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:34.555421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:34.556794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:34.565830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 633/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:34.571624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.666983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:34.686261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba026f58-2fff-4e30-98ce-0e85aee3cb75 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.720699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.721552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.721843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.722145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.739457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:34.741257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:34.768807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:34.769831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:34.770723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:34.770723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:34.770723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:34.770723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:34.770960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 604/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:34.777514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.894195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487395ec-57f3-473b-8441-6c70ed3a8842 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.905151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:34.934974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.935629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.935942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.936224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.937009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:34.937323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:34.938717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:34.951285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 634/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:34.962469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:35.065331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b780-205c-4519-af53-348341ea0332 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:35.099797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:35.100605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:35.100962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:35.101356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:35.104994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:35.112924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:35.114046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:35.129284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:35.130283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:35.131253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 605/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:35.136458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:35.249410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99abd4c-803f-4653-a8ca-bb8e6d4c746a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:35.289410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:35.290086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:35.290377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:35.290660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:35.291545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:35.291863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:35.293373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:35.313424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 635/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:35.319446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:35.430900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cb5f3-cc65-4202-a81e-0756634911c2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:35.469295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:35.469961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:35.470248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:35.470579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:35.540338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:35.547683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:35.549204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:35.653632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 606/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 04:08:35.660307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:35.691774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:35.780098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dcaa2-fb0e-4a19-8c67-e4cbccf13026 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:35.815482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:35.816277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:35.816570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:35.816956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:35.828756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:35.830253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:35.851941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:35.853077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:35.854027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:35.854027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:35.854027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:35.854027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:35.854027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 636/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:35.860226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:35.974198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:35.981795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442244a5-a161-4eb4-ae34-e860360cd115 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:36.022760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:36.023427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.023711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.023990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.024707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:36.025043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:36.026778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:36.042466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 607/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:36.049477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:36.143630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:36.169511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673eead-0b2c-43fb-8e86-d636f572dab4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:36.209839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:36.210645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.211005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.211286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.219805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:36.221368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:36.235497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:36.236484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:36.237544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 637/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:36.243447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:36.357300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3488fa-0428-4d8d-b5ea-a80cdec066fd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:36.396315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee474fc-8855-4b1d-8bb4-1672b91ba07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:36.396945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee474fc-8855-4b1d-8bb4-1672b91ba07c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.397274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee474fc-8855-4b1d-8bb4-1672b91ba07c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.397513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee474fc-8855-4b1d-8bb4-1672b91ba07c None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.398341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee474fc-8855-4b1d-8bb4-1672b91ba07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:36.398654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee474fc-8855-4b1d-8bb4-1672b91ba07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:36.400151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee474fc-8855-4b1d-8bb4-1672b91ba07c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:36.414127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 608/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:36.420587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:36.528110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f70bad-0dc8-481a-a60f-f99301e12c8d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:36.564018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15ea6b-5122-40a5-8f19-6391789cee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:36.564667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ea6b-5122-40a5-8f19-6391789cee6b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.564986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ea6b-5122-40a5-8f19-6391789cee6b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.565264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ea6b-5122-40a5-8f19-6391789cee6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.566121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15ea6b-5122-40a5-8f19-6391789cee6b None admin] RBAC: Adding query filter params (role.id=4dcc6b65bf2143728b2d8ba9b04eadb7, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=3357f08257be47b58cf048c12daabfad) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:36.566427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15ea6b-5122-40a5-8f19-6391789cee6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:36.567851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15ea6b-5122-40a5-8f19-6391789cee6b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:36.573647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 638/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:36 2022] GET /identity/v3/role_assignments?user.id=3357f08257be47b58cf048c12daabfad&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=4dcc6b65bf2143728b2d8ba9b04eadb7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:38.906548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fbc-3cbf-4ea7-b319-d719cfc72a7a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:38.907128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fbc-3cbf-4ea7-b319-d719cfc72a7a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:38.907128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fbc-3cbf-4ea7-b319-d719cfc72a7a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:38.908484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 609/1247] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:38.914369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b985ae-607c-4e07-aa97-4456f56f1892 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:38.914817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b985ae-607c-4e07-aa97-4456f56f1892 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:38.914950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b985ae-607c-4e07-aa97-4456f56f1892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:38.922133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:38.933955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c2b985ae-607c-4e07-aa97-4456f56f1892 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:38.936080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c2b985ae-607c-4e07-aa97-4456f56f1892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:39.014600 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 639/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:39.042970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1fbc-3cbf-4ea7-b319-d719cfc72a7a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:39.067436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:39.164789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1fbc-3cbf-4ea7-b319-d719cfc72a7a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:39.205782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:39.206504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:39.206790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:39.207155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:39.220988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:39.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:39.229632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:39.237108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 610/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:39.238000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b985ae-607c-4e07-aa97-4456f56f1892 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:39.343907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b985ae-607c-4e07-aa97-4456f56f1892 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:39.378326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:39.384405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:39.385155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:39.385465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:39.385791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:39.386563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:39.386947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:39.388977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:39.398489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 640/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:39.404682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:39.491715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:39.516052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67a15-46ab-48c9-af63-2e073a03f7fc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:39.555081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:39.555984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:39.556291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:39.556597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:39.568869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:39.570351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:39.591014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:39.592351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:39.593484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:39.593484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:39.593484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:39.593484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:39.593484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 611/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:39.599451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:39.711432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972dea-6047-46f8-b2a8-899f2cbbb3f3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:39.751637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:39.752253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:39.752541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:39.752844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:39.753569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:39.753886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:39.755265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:39.768683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 641/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:39.774486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:39.882971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a41e1-5451-422d-92bc-3a7e1a06e9ce None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:39.910509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:39.918605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:39.919953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:39.920246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:39.920610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:39.928223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:39.929864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:39.945840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:39.947023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:39.948045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 612/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:39.953720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:40.011577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:40.060627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9a8f9-1b47-4a09-b056-b3fe5abb4828 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:40.099014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:40.099741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:40.100033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:40.100317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:40.101199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:40.101536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:40.103152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:40.123418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 642/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:40.129584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:40.238873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897aaa2-34f9-46a0-b14b-dec41c796e0e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:40.275463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340493b-5565-44cc-994a-181528e0695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:40.276035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340493b-5565-44cc-994a-181528e0695d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:40.276321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340493b-5565-44cc-994a-181528e0695d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:40.276600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340493b-5565-44cc-994a-181528e0695d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:40.335355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:40.349360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340493b-5565-44cc-994a-181528e0695d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:40.350822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340493b-5565-44cc-994a-181528e0695d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:40.466632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 613/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:08:40.472600 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:40.582469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825e403-b2a8-4467-9eee-4d302a8b9b77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:40.597337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:40.620449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:40.621379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:40.621661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:40.621938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:40.633909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:40.635585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:40.656302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:40.657323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:40.658698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:40.658698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:40.658698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:40.658698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:40.658698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 643/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:40.663905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340493b-5565-44cc-994a-181528e0695d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:40.771019 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:40.785651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340493b-5565-44cc-994a-181528e0695d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:40.823368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:40.824062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:40.824355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:40.824637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:40.825416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:40.826386 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:40.827911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:40.840689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 614/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:40.847243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:40.955059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc445a40-da47-449d-a2be-ba0972bbe03a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:40.994834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:40.996237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:40.996756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:40.997306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:41.006028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:41.007509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:41.022311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:41.023296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:41.024199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 644/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:41.030647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:41.138288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59c5b-46fb-4fd5-9e50-cdf8c67c1046 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:41.174600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b43fe-4779-4639-a15c-4ccaa098097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:41.175279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b43fe-4779-4639-a15c-4ccaa098097f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:41.175573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b43fe-4779-4639-a15c-4ccaa098097f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:41.175836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b43fe-4779-4639-a15c-4ccaa098097f None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:41.176627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b43fe-4779-4639-a15c-4ccaa098097f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:41.176974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b43fe-4779-4639-a15c-4ccaa098097f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:41.178427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b43fe-4779-4639-a15c-4ccaa098097f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:41.191973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 615/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:41.198106 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:41.227564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:41.303872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05594a58-fdc6-4921-a365-a5cf174c4170 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:41.337949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865bd42-f4da-48a8-aaa9-2e0b9d61f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:41.338603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865bd42-f4da-48a8-aaa9-2e0b9d61f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:41.338887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865bd42-f4da-48a8-aaa9-2e0b9d61f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:41.339167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865bd42-f4da-48a8-aaa9-2e0b9d61f6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:41.340000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865bd42-f4da-48a8-aaa9-2e0b9d61f6c0 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=3357f08257be47b58cf048c12daabfad) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:41.340312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865bd42-f4da-48a8-aaa9-2e0b9d61f6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:41.342071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865bd42-f4da-48a8-aaa9-2e0b9d61f6c0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:41.347744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 645/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:41 2022] GET /identity/v3/role_assignments?user.id=3357f08257be47b58cf048c12daabfad&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:43.355789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9aff-1588-4976-a7f2-938988e74f78 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:43.356349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9aff-1588-4976-a7f2-938988e74f78 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:43.356349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9aff-1588-4976-a7f2-938988e74f78 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:43.357947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 616/1261] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:43.363226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf9ff-49eb-46a7-b208-cf4d1ce6e6c1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:43.363768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf9ff-49eb-46a7-b208-cf4d1ce6e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:43.363768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf9ff-49eb-46a7-b208-cf4d1ce6e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:43.383753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b8dbf9ff-49eb-46a7-b208-cf4d1ce6e6c1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:43.385031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b8dbf9ff-49eb-46a7-b208-cf4d1ce6e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:43.458482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 646/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:43.480655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9aff-1588-4976-a7f2-938988e74f78 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:43.492404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:43.581165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9aff-1588-4976-a7f2-938988e74f78 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:43.613746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:43.614455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:43.614994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:43.615269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:43.625744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:43.633345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:43.634440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:43.635666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 617/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:43.640832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf9ff-49eb-46a7-b208-cf4d1ce6e6c1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:43.658496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:43.737651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf9ff-49eb-46a7-b208-cf4d1ce6e6c1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:43.772282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:43.773082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:43.774280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:43.774582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:43.775327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:43.776448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:43.779167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:43.787872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 647/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:43.794992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:43.860194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:43.893761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45130cc3-58d1-4999-8587-e1f18cee0847 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:43.927030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:43.927811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:43.928101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:43.928385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:43.938936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:43.940382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:43.957262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:43.958354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:43.959650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:43.959650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:43.959650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:43.959650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:43.959650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 618/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:43.964273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:44.042107 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:44.061248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821215d9-4ac9-43bc-b915-0785832d86d3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:44.093626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:44.094274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:44.094556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:44.094830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:44.095544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:44.095846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:44.097230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:44.109159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 648/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:44.115004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:44.212381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb8d8-7890-4503-a723-1bbf39be1c39 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:44.231583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:44.245719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:44.246498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:44.246782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:44.247061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:44.255242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:44.256698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:44.271320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:44.272264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:44.273361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 619/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:44.278169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:44.380115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de84865-c519-4fb3-b86e-daf1f0e0bb60 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:44.415974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:44.416638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:44.416959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:44.417261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:44.418076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:44.418388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:44.420088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:44.429325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:44.437993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 649/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:44.443633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:44.541428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520327f8-f46e-4dd3-a4ff-a2f36e979210 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:44.573720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:44.574488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:44.574773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:44.575054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:44.586070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:44.587512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:44.604419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:44.605486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:44.606639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:44.606639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:44.606639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:44.606639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:44.606639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 620/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:44.611490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:44.710017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd6344-3a1c-472f-b821-ccb43b6d6d86 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:44.743312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:44.743960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:44.744240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:44.744515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:44.745256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:44.745563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:44.746919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:44.758424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 650/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:44.764738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:44.795624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:44.862030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014bc77-d542-4f17-aa9f-f23d5cb84731 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:44.895218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:44.895996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:44.896280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:44.896560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:44.903100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:44.904747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:44.918878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:44.920758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:44.921759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 621/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:44.926910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:44.984170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:45.025745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef490b6-d6da-4b30-a68d-ab79f524e335 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:45.058330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe05eb-3314-4f31-9fa6-18a171bccc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:45.058911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe05eb-3314-4f31-9fa6-18a171bccc43 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:45.059191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe05eb-3314-4f31-9fa6-18a171bccc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:45.059490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe05eb-3314-4f31-9fa6-18a171bccc43 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:45.061071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe05eb-3314-4f31-9fa6-18a171bccc43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:45.061381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe05eb-3314-4f31-9fa6-18a171bccc43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:45.062822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe05eb-3314-4f31-9fa6-18a171bccc43 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:45.074358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 651/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:45.080841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:45.170104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:45.178801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21ff1-52cb-47d6-affb-94df0697c3e0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:45.212102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67755a8-4b25-41c1-b3ab-87fad5f63189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:45.213005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67755a8-4b25-41c1-b3ab-87fad5f63189 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:45.213291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67755a8-4b25-41c1-b3ab-87fad5f63189 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:45.213572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67755a8-4b25-41c1-b3ab-87fad5f63189 None admin] PATH_INFO: `/v3/projects/62a6a9eed4b241179bff501834eba63f/users/3357f08257be47b58cf048c12daabfad/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:45.220850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67755a8-4b25-41c1-b3ab-87fad5f63189 None admin] RBAC: Authorizing `identity:create_grant(project_id=62a6a9eed4b241179bff501834eba63f, user_id=3357f08257be47b58cf048c12daabfad, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:45.220850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67755a8-4b25-41c1-b3ab-87fad5f63189 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:45.232246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 622/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Jul 21 04:08:45 2022] PUT /identity/v3/projects/62a6a9eed4b241179bff501834eba63f/users/3357f08257be47b58cf048c12daabfad/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:08:47.253411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238654-ca03-4544-ae9f-1f6ea53e971a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:47.253946 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238654-ca03-4544-ae9f-1f6ea53e971a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:47.254064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238654-ca03-4544-ae9f-1f6ea53e971a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:47.255352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 652/1274] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:47.260364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4ad33-3fd5-4c3b-a13f-a1992201d0c1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:47.260758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4ad33-3fd5-4c3b-a13f-a1992201d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:47.260953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4ad33-3fd5-4c3b-a13f-a1992201d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:47.277434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fcd4ad33-3fd5-4c3b-a13f-a1992201d0c1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:47.278650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fcd4ad33-3fd5-4c3b-a13f-a1992201d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:47.343823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 623/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:47.369153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238654-ca03-4544-ae9f-1f6ea53e971a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:47.478010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238654-ca03-4544-ae9f-1f6ea53e971a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:47.495064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:47.512215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:47.513099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:47.513378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:47.513655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:47.523331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:47.531649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:47.532785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:47.533795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 653/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Jul 21 04:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:47.538901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4ad33-3fd5-4c3b-a13f-a1992201d0c1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:47.622375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:47.641879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4ad33-3fd5-4c3b-a13f-a1992201d0c1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:47.681673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:47.682348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:47.682636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:47.682917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:47.683665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:47.683976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:47.685530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:47.693760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 624/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Jul 21 04:08:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:47.699638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:47.803280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35dd8e-390a-4700-8c42-f1871185060e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:47.835436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:47.836221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:47.836509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:47.836791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:47.847660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:47.849142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:47.866637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:47.867711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:47.869053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:47.869053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:47.869053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:47.869053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:47.869053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 654/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:47.873806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:47.972466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034911e-ed2b-463a-9c45-548ea020fd5b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:48.005081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:48.005735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:48.006023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:48.006305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:48.007024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:48.007337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:48.008706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:48.020785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 625/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:48.026300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:48.057981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:48.126933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719de5e-944c-4cc7-9b6f-309cafea560a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:48.160649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:48.161469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:48.161756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:48.162034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:48.169311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:48.170751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:48.184854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:48.186032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:48.187014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 655/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:48.191747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:48.195477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:48.288262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d94a5-1998-4c7e-8363-00836669d168 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:48.320707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:48.321329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:48.321611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:48.321884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:48.322702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:48.323008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:48.324430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:48.341499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 626/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:48.347182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:48.440685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:48.450632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365d6a-3e6d-4720-9a03-f0ee066902a3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:48.482527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:48.483158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:48.483439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:48.483717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:48.547897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:48.549406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:48.635679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:48.646486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 656/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:08:48.652294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:48.712257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:48.751050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4b43-c4da-44cf-bc6d-f2ffa5a2efc9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:48.783677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:48.784459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:48.784743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:48.785054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:48.795393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:48.796857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:48.814415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:48.815627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:48.816662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:48.816662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:48.816662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:48.816662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:48.816662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 627/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:48.821295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:48.916496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5a64-3a4c-43c5-b509-52cfa3b16e65 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:48.950060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:48.950767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:48.951056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:48.951337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:48.952056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:48.952365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:48.953755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:48.964932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 657/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:48.970785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:49.068935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40adee-9fb6-492a-97de-ef049d8708e9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:49.082792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:49.103022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:49.103810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:49.104099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:49.104383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:49.111545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:49.113036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:49.126731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:49.127809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jul 21 04:08:49.128976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 628/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:49.133691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:49.183798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:49.235601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bde91-1cf6-4812-ba37-cec753c0b47d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:49.268201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46f50a-dec1-4a7d-a410-987dd650efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:49.268875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f50a-dec1-4a7d-a410-987dd650efd1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:49.269162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f50a-dec1-4a7d-a410-987dd650efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:49.269441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46f50a-dec1-4a7d-a410-987dd650efd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:49.270221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f50a-dec1-4a7d-a410-987dd650efd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:49.270531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f50a-dec1-4a7d-a410-987dd650efd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:49.271963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46f50a-dec1-4a7d-a410-987dd650efd1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:49.284696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 658/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:49.294248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:49.406062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca426f5-752e-4e1f-9daf-ded21051280e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:49.439254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ba607-2292-401b-a789-4e2b992b89f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:49.439839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ba607-2292-401b-a789-4e2b992b89f9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:49.440122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ba607-2292-401b-a789-4e2b992b89f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:49.440401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ba607-2292-401b-a789-4e2b992b89f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:49.441253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ba607-2292-401b-a789-4e2b992b89f9 None admin] RBAC: Adding query filter params (role.id=b0c1afc284ad4d8aa049e2da36fe5f40, scope.project.id=62a6a9eed4b241179bff501834eba63f, user.id=3357f08257be47b58cf048c12daabfad) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:49.441567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ba607-2292-401b-a789-4e2b992b89f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:49.442996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ba607-2292-401b-a789-4e2b992b89f9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:49.448633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 629/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:49 2022] GET /identity/v3/role_assignments?user.id=3357f08257be47b58cf048c12daabfad&scope.project.id=62a6a9eed4b241179bff501834eba63f&role.id=b0c1afc284ad4d8aa049e2da36fe5f40 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:51.494114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ad86c-71e0-4118-b045-616fb400802d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:51.494649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ad86c-71e0-4118-b045-616fb400802d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:51.494649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ad86c-71e0-4118-b045-616fb400802d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:51.496042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 659/1288] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:51.501268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef45c4-4d93-46ca-a555-13e6d07b6589 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:51.501666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef45c4-4d93-46ca-a555-13e6d07b6589 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:51.501830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef45c4-4d93-46ca-a555-13e6d07b6589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:51.518303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-49ef45c4-4d93-46ca-a555-13e6d07b6589 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:51.519485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-49ef45c4-4d93-46ca-a555-13e6d07b6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:51.548808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:51.585605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 630/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:51.608686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ad86c-71e0-4118-b045-616fb400802d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:51.708049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ad86c-71e0-4118-b045-616fb400802d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:51.718825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:51.742310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:51.743103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:51.743392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:51.743675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:51.744378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:51.745731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:51.757740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:51.758980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:51.760049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 660/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:08:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:51.765674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef45c4-4d93-46ca-a555-13e6d07b6589 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:51.860706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef45c4-4d93-46ca-a555-13e6d07b6589 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:51.894239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb3f83-0db5-41e5-9ecd-43c842c0af07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:51.894888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3f83-0db5-41e5-9ecd-43c842c0af07 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:51.895172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3f83-0db5-41e5-9ecd-43c842c0af07 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:51.895454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3f83-0db5-41e5-9ecd-43c842c0af07 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:51.896151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb3f83-0db5-41e5-9ecd-43c842c0af07 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:51.896463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb3f83-0db5-41e5-9ecd-43c842c0af07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:51.897858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb3f83-0db5-41e5-9ecd-43c842c0af07 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:51.902567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 631/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:51.908938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:52.005817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94757f99-2958-4492-af42-8a7c25d926d4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:52.038185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410035c-9065-4351-b37d-8a5385deb6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:52.038823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410035c-9065-4351-b37d-8a5385deb6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:52.039104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410035c-9065-4351-b37d-8a5385deb6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:52.039378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410035c-9065-4351-b37d-8a5385deb6f1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:52.040070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410035c-9065-4351-b37d-8a5385deb6f1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:52.040373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410035c-9065-4351-b37d-8a5385deb6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:52.041765 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410035c-9065-4351-b37d-8a5385deb6f1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:52.046170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 661/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:54.060297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bdbea-22c7-43f4-a090-ad978ef72980 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:54.060842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bdbea-22c7-43f4-a090-ad978ef72980 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:54.060952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bdbea-22c7-43f4-a090-ad978ef72980 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:54.062232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 632/1293] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:54.067443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41dd4-9ae9-46ec-bf99-0c334cd2f780 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:54.067889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41dd4-9ae9-46ec-bf99-0c334cd2f780 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:54.067993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41dd4-9ae9-46ec-bf99-0c334cd2f780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:54.084423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e0e41dd4-9ae9-46ec-bf99-0c334cd2f780 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:54.085679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e0e41dd4-9ae9-46ec-bf99-0c334cd2f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:54.114729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:54.151349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 662/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:54.174182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bdbea-22c7-43f4-a090-ad978ef72980 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:54.205096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:54.273803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bdbea-22c7-43f4-a090-ad978ef72980 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:54.307002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85ac60-dbd7-40e0-9224-ff7b476094cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:54.307653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85ac60-dbd7-40e0-9224-ff7b476094cd None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:54.307937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85ac60-dbd7-40e0-9224-ff7b476094cd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:54.308218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85ac60-dbd7-40e0-9224-ff7b476094cd None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:54.308990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85ac60-dbd7-40e0-9224-ff7b476094cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:54.310412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85ac60-dbd7-40e0-9224-ff7b476094cd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:54.322666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 633/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Jul 21 04:08:54 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:08:56.339106 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af86ee-d6ec-4e71-9fc3-82c929cc07a1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:56.339665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af86ee-d6ec-4e71-9fc3-82c929cc07a1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:56.339665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af86ee-d6ec-4e71-9fc3-82c929cc07a1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:56.341135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 663/1296] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:56.346333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425fee7-c15c-4ac9-a3de-7be0f2ed6fc2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:56.346743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425fee7-c15c-4ac9-a3de-7be0f2ed6fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:56.346902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425fee7-c15c-4ac9-a3de-7be0f2ed6fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:56.364149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0425fee7-c15c-4ac9-a3de-7be0f2ed6fc2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:56.365900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0425fee7-c15c-4ac9-a3de-7be0f2ed6fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:56.449383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 634/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:56.472312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af86ee-d6ec-4e71-9fc3-82c929cc07a1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:56.570159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af86ee-d6ec-4e71-9fc3-82c929cc07a1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:56.602758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:56.603487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:56.603773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:56.604051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:56.604693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:56.606723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:56.618641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:56.619840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:56.621212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 664/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:08:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:56.625758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425fee7-c15c-4ac9-a3de-7be0f2ed6fc2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:56.643554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:56.726278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425fee7-c15c-4ac9-a3de-7be0f2ed6fc2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:56.759602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:56.760251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:56.760532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:56.760809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:56.761527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:56.761836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:56.763662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:56.768619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 635/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:56.774545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:56.806092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:56.872813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcb3d8-c5f0-4ef8-8735-c6b526d48677 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:56.905422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eb991-d9cc-459a-855b-c1e04ba26baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:56.906066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eb991-d9cc-459a-855b-c1e04ba26baa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:56.906351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eb991-d9cc-459a-855b-c1e04ba26baa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:56.906646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eb991-d9cc-459a-855b-c1e04ba26baa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:56.907410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eb991-d9cc-459a-855b-c1e04ba26baa None admin] RBAC: Adding query filter params (interface=public, service_id=f79514d1ec254cc9a3abaeb351387058, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:56.907721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eb991-d9cc-459a-855b-c1e04ba26baa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:56.909105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eb991-d9cc-459a-855b-c1e04ba26baa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:56.914017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 665/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Jul 21 04:08:56 2022] GET /identity/v3/endpoints?service_id=f79514d1ec254cc9a3abaeb351387058&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:56.920139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:57.001190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:57.019727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d448-64c0-41a1-a1b5-438934e23298 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:57.053113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eab88-0f4f-4238-b33c-5b54709280b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:57.053769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eab88-0f4f-4238-b33c-5b54709280b5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:57.054059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eab88-0f4f-4238-b33c-5b54709280b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:57.054344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eab88-0f4f-4238-b33c-5b54709280b5 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:57.055020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eab88-0f4f-4238-b33c-5b54709280b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:57.056395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eab88-0f4f-4238-b33c-5b54709280b5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:57.063110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 636/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Jul 21 04:08:56 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:08:59.046399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b0db-5c51-460d-a30d-c4dfbf1a89c0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:59.046925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b0db-5c51-460d-a30d-c4dfbf1a89c0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:59.047037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b0db-5c51-460d-a30d-c4dfbf1a89c0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:59.048311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 666/1302] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:59.053405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c7fc-4edf-42ba-97c9-e2752cdb0299 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:59.053826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c7fc-4edf-42ba-97c9-e2752cdb0299 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:59.053963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c7fc-4edf-42ba-97c9-e2752cdb0299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:59.070477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6168c7fc-4edf-42ba-97c9-e2752cdb0299 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:59.071650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6168c7fc-4edf-42ba-97c9-e2752cdb0299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:59.136717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 637/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:08:59.159877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b0db-5c51-460d-a30d-c4dfbf1a89c0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:59.252639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:59.259580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b0db-5c51-460d-a30d-c4dfbf1a89c0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:59.292746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:59.293591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:59.293842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:59.294120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:59.294770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:59.296122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:59.307754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:59.309173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:59.310094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jul 21 04:08:59.312991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 667/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Jul 21 04:08:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:59.314725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c7fc-4edf-42ba-97c9-e2752cdb0299 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:59.389695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:59.414278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c7fc-4edf-42ba-97c9-e2752cdb0299 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:59.447954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0393d-9cd4-485a-8a45-3b76cf819ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:59.448603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0393d-9cd4-485a-8a45-3b76cf819ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:59.448912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0393d-9cd4-485a-8a45-3b76cf819ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:59.449192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0393d-9cd4-485a-8a45-3b76cf819ed4 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:59.451819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0393d-9cd4-485a-8a45-3b76cf819ed4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:59.452131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0393d-9cd4-485a-8a45-3b76cf819ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:59.453532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0393d-9cd4-485a-8a45-3b76cf819ed4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:59.458532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 638/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:59.464217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:59.563435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64df4-848c-42b3-847a-812716a95d68 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:59.596196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90b56-100b-41e6-b816-6ac651a947f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:59.596866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90b56-100b-41e6-b816-6ac651a947f2 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:59.597160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90b56-100b-41e6-b816-6ac651a947f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:59.597445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90b56-100b-41e6-b816-6ac651a947f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:59.598181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90b56-100b-41e6-b816-6ac651a947f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:59.599545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90b56-100b-41e6-b816-6ac651a947f2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:59.617339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 668/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Jul 21 04:08:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:09:09.455561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=30 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:09.612707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:02.357037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75182ab-e9f1-4008-a1b2-59c1b6c19629 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:02.358047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75182ab-e9f1-4008-a1b2-59c1b6c19629 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:02.358558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75182ab-e9f1-4008-a1b2-59c1b6c19629 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:02.360731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 639/1307] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:02.366043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0889cc-e8ed-47b7-974a-9b19cabff5b1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:02.366499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0889cc-e8ed-47b7-974a-9b19cabff5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:02.366692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0889cc-e8ed-47b7-974a-9b19cabff5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:02.543921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b0889cc-e8ed-47b7-974a-9b19cabff5b1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:02.545187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b0889cc-e8ed-47b7-974a-9b19cabff5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:02.776855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 669/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:02.812215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab87f-ae91-480e-a016-785fb2d1e604 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:02.812924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab87f-ae91-480e-a016-785fb2d1e604 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:02.813433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eab87f-ae91-480e-a016-785fb2d1e604 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:02.815287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 640/1309] 10.222.0.45 () {54 vars in 965 bytes} [Thu Jul 21 04:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:02.820970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c022d-cf30-411a-ac08-92805d30ad80 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:02.821881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c022d-cf30-411a-ac08-92805d30ad80 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:02.822227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c022d-cf30-411a-ac08-92805d30ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:02.908885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3b8c022d-cf30-411a-ac08-92805d30ad80 None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:02.910054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b8c022d-cf30-411a-ac08-92805d30ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:02.933259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:02.998753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 670/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Jul 21 04:10:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:03.007712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab87f-ae91-480e-a016-785fb2d1e604 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:03.009705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b6eab87f-ae91-480e-a016-785fb2d1e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:03.157220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eab87f-ae91-480e-a016-785fb2d1e604 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:03.248083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3166f-15fe-4ff9-99b1-b3519590d3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:03.248745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3166f-15fe-4ff9-99b1-b3519590d3fd service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:03.249200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3166f-15fe-4ff9-99b1-b3519590d3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:03.249486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3166f-15fe-4ff9-99b1-b3519590d3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:03.251179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a8c3166f-15fe-4ff9-99b1-b3519590d3fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:03.327106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:03.388574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3166f-15fe-4ff9-99b1-b3519590d3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:03.391195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3166f-15fe-4ff9-99b1-b3519590d3fd service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:03.412390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 641/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:05.793458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6204d3-68bb-40a4-81db-683ef756619d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:05.793992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6204d3-68bb-40a4-81db-683ef756619d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:05.794113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6204d3-68bb-40a4-81db-683ef756619d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:05.795407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 671/1312] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:05.800668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c583-efba-4b47-880f-cefaf6875e6a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:05.801135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c583-efba-4b47-880f-cefaf6875e6a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:05.801358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199c583-efba-4b47-880f-cefaf6875e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:05.874265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7199c583-efba-4b47-880f-cefaf6875e6a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:05.875794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7199c583-efba-4b47-880f-cefaf6875e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:05.973024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 642/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:06.012990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6204d3-68bb-40a4-81db-683ef756619d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:06.014655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e6204d3-68bb-40a4-81db-683ef756619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:06.127630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6204d3-68bb-40a4-81db-683ef756619d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:06.199627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:06.202220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe2e53-814b-46f1-9a42-888aa6ef94d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:06.203070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2e53-814b-46f1-9a42-888aa6ef94d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:06.203403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2e53-814b-46f1-9a42-888aa6ef94d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:06.203888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2e53-814b-46f1-9a42-888aa6ef94d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:06.205828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-04fe2e53-814b-46f1-9a42-888aa6ef94d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:06.315916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe2e53-814b-46f1-9a42-888aa6ef94d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:06.317405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe2e53-814b-46f1-9a42-888aa6ef94d4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:06.335695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 672/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:08.711982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4683fa-3ccb-405f-935e-932a06f4dcf0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:08.712514 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4683fa-3ccb-405f-935e-932a06f4dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:08.712609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4683fa-3ccb-405f-935e-932a06f4dcf0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:08.713966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 643/1315] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:08.719049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2f992-05a5-4696-a005-2e94bbd8341e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:08.719428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2f992-05a5-4696-a005-2e94bbd8341e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:08.719611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2f992-05a5-4696-a005-2e94bbd8341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:08.785086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-40f2f992-05a5-4696-a005-2e94bbd8341e None None] MFA Rules not processed for user `d303ee7e56ab47ceaf4c6157d31aa0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:08.786287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-40f2f992-05a5-4696-a005-2e94bbd8341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:08.838815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:08.884174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 673/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:08.923828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4683fa-3ccb-405f-935e-932a06f4dcf0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:08.925330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ef4683fa-3ccb-405f-935e-932a06f4dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:08.935610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:09.027670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4683fa-3ccb-405f-935e-932a06f4dcf0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:09.100170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dea27-a830-4d95-a50c-1a7c44240f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:09.100809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dea27-a830-4d95-a50c-1a7c44240f2e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:09.101132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dea27-a830-4d95-a50c-1a7c44240f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:09.101400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dea27-a830-4d95-a50c-1a7c44240f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:09.103928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e77dea27-a830-4d95-a50c-1a7c44240f2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:09.165579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:09.211695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dea27-a830-4d95-a50c-1a7c44240f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:09.213088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dea27-a830-4d95-a50c-1a7c44240f2e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:09.232545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 644/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:11.837413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea54c8-5101-40de-811e-225536af8041 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:11.838446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea54c8-5101-40de-811e-225536af8041 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:11.838538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea54c8-5101-40de-811e-225536af8041 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:11.839853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 674/1318] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:11.845059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603147-e97c-4ac5-a65b-a85e47708ae9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:11.845440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603147-e97c-4ac5-a65b-a85e47708ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:11.845628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603147-e97c-4ac5-a65b-a85e47708ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:11.909127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9f603147-e97c-4ac5-a65b-a85e47708ae9 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:11.910342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f603147-e97c-4ac5-a65b-a85e47708ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:12.004369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 645/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:10:12.043884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea54c8-5101-40de-811e-225536af8041 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:12.045486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-48ea54c8-5101-40de-811e-225536af8041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:12.146861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea54c8-5101-40de-811e-225536af8041 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:12.219819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67ba00-33f4-4024-a1f7-9383120699f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:12.220463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67ba00-33f4-4024-a1f7-9383120699f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:12.220751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67ba00-33f4-4024-a1f7-9383120699f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:12.221073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67ba00-33f4-4024-a1f7-9383120699f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:12.222704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-be67ba00-33f4-4024-a1f7-9383120699f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:12.229651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:12.331170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67ba00-33f4-4024-a1f7-9383120699f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:12.332610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67ba00-33f4-4024-a1f7-9383120699f4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:12.350066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 675/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:15.072379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b6241-1fdf-4b5b-b651-21946f4dcd00 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:15.072941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b6241-1fdf-4b5b-b651-21946f4dcd00 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:15.073069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b6241-1fdf-4b5b-b651-21946f4dcd00 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:15.074417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 646/1321] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:15.080275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd4efc-e558-4a27-b6ca-6d9237370474 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:15.080739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd4efc-e558-4a27-b6ca-6d9237370474 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:15.080862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd4efc-e558-4a27-b6ca-6d9237370474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:15.146390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-42cd4efc-e558-4a27-b6ca-6d9237370474 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:15.147638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-42cd4efc-e558-4a27-b6ca-6d9237370474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:15.214299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:15.257918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 676/1322] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:15.295331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b6241-1fdf-4b5b-b651-21946f4dcd00 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:15.296950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c0b6241-1fdf-4b5b-b651-21946f4dcd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:15.316728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:15.408615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b6241-1fdf-4b5b-b651-21946f4dcd00 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:15.482259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2a184-04a7-4b28-a66b-66eb211b561b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:15.482910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a184-04a7-4b28-a66b-66eb211b561b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:15.483195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a184-04a7-4b28-a66b-66eb211b561b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:15.483473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a184-04a7-4b28-a66b-66eb211b561b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:15.485160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1eb2a184-04a7-4b28-a66b-66eb211b561b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:15.558478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:15.598615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2a184-04a7-4b28-a66b-66eb211b561b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:15.600065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2a184-04a7-4b28-a66b-66eb211b561b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:15.621017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 647/1323] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:17.702695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111426e-2326-4747-9e7c-fc296161623c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:17.703218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111426e-2326-4747-9e7c-fc296161623c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:17.703314 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111426e-2326-4747-9e7c-fc296161623c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:17.704700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 677/1324] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:17.710168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb34f-d820-4145-bd81-cd453e658d29 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:17.710582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb34f-d820-4145-bd81-cd453e658d29 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:17.710691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb34f-d820-4145-bd81-cd453e658d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:17.777657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-aecdb34f-d820-4145-bd81-cd453e658d29 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:17.778917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-aecdb34f-d820-4145-bd81-cd453e658d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:17.877213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 648/1325] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:17.913767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111426e-2326-4747-9e7c-fc296161623c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:17.915315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4111426e-2326-4747-9e7c-fc296161623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:18.024705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111426e-2326-4747-9e7c-fc296161623c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:18.104474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f712cf-7c4d-4959-b179-be4f5eac9af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:18.105156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f712cf-7c4d-4959-b179-be4f5eac9af5 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:18.105446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f712cf-7c4d-4959-b179-be4f5eac9af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:18.105729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f712cf-7c4d-4959-b179-be4f5eac9af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:18.107386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9f712cf-7c4d-4959-b179-be4f5eac9af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:18.125527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:18.223656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f712cf-7c4d-4959-b179-be4f5eac9af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:18.225138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f712cf-7c4d-4959-b179-be4f5eac9af5 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:18.244661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 678/1326] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:20.365144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b9dc-42c6-49b1-a169-42503afc78ef None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:20.365702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b9dc-42c6-49b1-a169-42503afc78ef None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:20.365702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b9dc-42c6-49b1-a169-42503afc78ef None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:20.367068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 649/1327] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:20.373198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9001f-65e9-4a51-aded-163dff4071c0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:20.373687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9001f-65e9-4a51-aded-163dff4071c0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:20.373793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9001f-65e9-4a51-aded-163dff4071c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:20.441353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ed9001f-65e9-4a51-aded-163dff4071c0 None None] MFA Rules not processed for user `d303ee7e56ab47ceaf4c6157d31aa0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:20.442549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ed9001f-65e9-4a51-aded-163dff4071c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:20.513052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:20.545671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 679/1328] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:20.584293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412b9dc-42c6-49b1-a169-42503afc78ef None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:20.585849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7412b9dc-42c6-49b1-a169-42503afc78ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:20.618047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:20.694359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412b9dc-42c6-49b1-a169-42503afc78ef None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:20.775282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739d08-28e2-47c7-b195-177679cc2b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:20.775931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739d08-28e2-47c7-b195-177679cc2b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:20.776219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739d08-28e2-47c7-b195-177679cc2b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:20.776503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739d08-28e2-47c7-b195-177679cc2b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:20.778209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d6739d08-28e2-47c7-b195-177679cc2b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:20.854965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:20.902126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739d08-28e2-47c7-b195-177679cc2b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:20.903571 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739d08-28e2-47c7-b195-177679cc2b00 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:20.925787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 650/1329] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:23.231883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde4ea-3056-44e7-86be-d1dc3484e123 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:23.232420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde4ea-3056-44e7-86be-d1dc3484e123 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:23.232420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde4ea-3056-44e7-86be-d1dc3484e123 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:23.233767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 680/1330] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:23.239207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d6e4-0785-46c1-8d0d-c236e2002006 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:23.239643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d6e4-0785-46c1-8d0d-c236e2002006 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:23.239806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d6e4-0785-46c1-8d0d-c236e2002006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:23.305425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8180d6e4-0785-46c1-8d0d-c236e2002006 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:23.306645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8180d6e4-0785-46c1-8d0d-c236e2002006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:23.403563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 651/1331] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:23.455109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b5fa-ca36-4568-9e89-0858655f709d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:23.455404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b5fa-ca36-4568-9e89-0858655f709d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:23.455685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b5fa-ca36-4568-9e89-0858655f709d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:23.457110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 681/1332] 10.222.0.45 () {54 vars in 965 bytes} [Thu Jul 21 04:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:23.463474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a3259-6ec6-46d5-8f1a-e5764240847f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:23.463764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a3259-6ec6-46d5-8f1a-e5764240847f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:23.464042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a3259-6ec6-46d5-8f1a-e5764240847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:23.507759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:23.538808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4c6a3259-6ec6-46d5-8f1a-e5764240847f None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:23.540033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4c6a3259-6ec6-46d5-8f1a-e5764240847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:23.615138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 652/1333] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Jul 21 04:10:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:23.624918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b5fa-ca36-4568-9e89-0858655f709d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:23.626469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4f9b5fa-ca36-4568-9e89-0858655f709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:23.729847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b5fa-ca36-4568-9e89-0858655f709d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:23.801829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31d6b3-4f62-4243-85fd-79ecf6c30cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:23.802497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31d6b3-4f62-4243-85fd-79ecf6c30cba service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:23.802779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31d6b3-4f62-4243-85fd-79ecf6c30cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:23.803055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31d6b3-4f62-4243-85fd-79ecf6c30cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:23.804680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1b31d6b3-4f62-4243-85fd-79ecf6c30cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:23.832158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:23.912669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31d6b3-4f62-4243-85fd-79ecf6c30cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:23.914136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31d6b3-4f62-4243-85fd-79ecf6c30cba service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:23.934457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 682/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:26.254596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588069-daed-4e3d-b892-e9f061660416 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:26.255142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588069-daed-4e3d-b892-e9f061660416 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:26.255142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588069-daed-4e3d-b892-e9f061660416 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:26.256561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 653/1335] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:26.262316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3960d73-82f0-4bc8-8e7b-ae7c3c52b9e7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:26.262767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3960d73-82f0-4bc8-8e7b-ae7c3c52b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:26.262907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3960d73-82f0-4bc8-8e7b-ae7c3c52b9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:26.328072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d3960d73-82f0-4bc8-8e7b-ae7c3c52b9e7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:26.329324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d3960d73-82f0-4bc8-8e7b-ae7c3c52b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:26.404908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:26.428218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 683/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:26.469558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06588069-daed-4e3d-b892-e9f061660416 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:26.471140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-06588069-daed-4e3d-b892-e9f061660416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:26.591026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06588069-daed-4e3d-b892-e9f061660416 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:26.621541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:26.677617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76b1ef-6d1b-4b82-9cc0-570055c77cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:26.678295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b1ef-6d1b-4b82-9cc0-570055c77cab service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:26.678584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b1ef-6d1b-4b82-9cc0-570055c77cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:26.678867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b1ef-6d1b-4b82-9cc0-570055c77cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:26.680624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a76b1ef-6d1b-4b82-9cc0-570055c77cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:26.813097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76b1ef-6d1b-4b82-9cc0-570055c77cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:26.814552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76b1ef-6d1b-4b82-9cc0-570055c77cab service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:26.834784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 654/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:29.239489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fcb6-a13a-42b9-9587-0e7fec498aaa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:29.240034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fcb6-a13a-42b9-9587-0e7fec498aaa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:29.240412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fcb6-a13a-42b9-9587-0e7fec498aaa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:29.241842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 684/1338] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:29.247909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8583-e209-454b-b75a-90b522a66f01 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:29.248357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8583-e209-454b-b75a-90b522a66f01 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:29.248457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8583-e209-454b-b75a-90b522a66f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:29.314332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-395e8583-e209-454b-b75a-90b522a66f01 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:29.315557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-395e8583-e209-454b-b75a-90b522a66f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:29.323750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:29.414474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 655/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:29.451203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fcb6-a13a-42b9-9587-0e7fec498aaa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:29.452724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b79fcb6-a13a-42b9-9587-0e7fec498aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:29.554413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fcb6-a13a-42b9-9587-0e7fec498aaa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:29.625875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762cba7-c542-4747-b15d-33a4c13e2b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:29.626516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762cba7-c542-4747-b15d-33a4c13e2b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:29.626799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762cba7-c542-4747-b15d-33a4c13e2b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:29.627073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762cba7-c542-4747-b15d-33a4c13e2b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:29.628884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6762cba7-c542-4747-b15d-33a4c13e2b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:29.664182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:29.739008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762cba7-c542-4747-b15d-33a4c13e2b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:29.740442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762cba7-c542-4747-b15d-33a4c13e2b15 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:29.759316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 685/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:33.734535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0803f2-f7f0-48a2-ae9b-10282f01b3fa None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:33.735038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0803f2-f7f0-48a2-ae9b-10282f01b3fa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:33.735038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0803f2-f7f0-48a2-ae9b-10282f01b3fa None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:33.736623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 656/1341] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:33.741805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642edfd6-d54a-449b-bfab-c8f9a326c28e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:33.742232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642edfd6-d54a-449b-bfab-c8f9a326c28e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:33.743230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642edfd6-d54a-449b-bfab-c8f9a326c28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:33.809454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-642edfd6-d54a-449b-bfab-c8f9a326c28e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:33.810644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-642edfd6-d54a-449b-bfab-c8f9a326c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:33.896057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:33.908554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 686/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:33.949174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0803f2-f7f0-48a2-ae9b-10282f01b3fa None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:33.950746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0b0803f2-f7f0-48a2-ae9b-10282f01b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:34.058493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0803f2-f7f0-48a2-ae9b-10282f01b3fa None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:34.097063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:34.134459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bd5c7-e2c7-49d2-844e-db63407362bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:34.135111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd5c7-e2c7-49d2-844e-db63407362bc service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:34.135398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd5c7-e2c7-49d2-844e-db63407362bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:34.135678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd5c7-e2c7-49d2-844e-db63407362bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:34.137349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-945bd5c7-e2c7-49d2-844e-db63407362bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:34.249115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bd5c7-e2c7-49d2-844e-db63407362bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:34.250702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bd5c7-e2c7-49d2-844e-db63407362bc service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:34.270678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 657/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:36.964718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46512ed-392d-4324-bbe6-cf6c9ea1d69c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:36.965290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46512ed-392d-4324-bbe6-cf6c9ea1d69c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:36.965290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46512ed-392d-4324-bbe6-cf6c9ea1d69c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:36.966674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 687/1344] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:36.972449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003657-d410-4aa7-afaa-a76af8285344 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:36.972980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003657-d410-4aa7-afaa-a76af8285344 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:36.973064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003657-d410-4aa7-afaa-a76af8285344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:37.042769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-91003657-d410-4aa7-afaa-a76af8285344 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:37.043982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-91003657-d410-4aa7-afaa-a76af8285344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:37.063421 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:37.143909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 658/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:37.181156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46512ed-392d-4324-bbe6-cf6c9ea1d69c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:37.182761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a46512ed-392d-4324-bbe6-cf6c9ea1d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:37.285230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46512ed-392d-4324-bbe6-cf6c9ea1d69c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:37.358853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21051bb4-61ee-4c7b-9ed1-df6a1b646141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:37.359514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051bb4-61ee-4c7b-9ed1-df6a1b646141 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:37.359804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051bb4-61ee-4c7b-9ed1-df6a1b646141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:37.360087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051bb4-61ee-4c7b-9ed1-df6a1b646141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:37.362053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21051bb4-61ee-4c7b-9ed1-df6a1b646141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:37.407663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:37.474102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21051bb4-61ee-4c7b-9ed1-df6a1b646141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:37.475547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21051bb4-61ee-4c7b-9ed1-df6a1b646141 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:37.494759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 688/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:41.518981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c0bd-1236-4e12-bd6a-879ad736a816 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:41.519536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c0bd-1236-4e12-bd6a-879ad736a816 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:41.519536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c0bd-1236-4e12-bd6a-879ad736a816 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:41.520960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 659/1347] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:41.526342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1763-4bad-4a03-a4e9-e70cd44a2f9a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:41.526789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1763-4bad-4a03-a4e9-e70cd44a2f9a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:41.526884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1763-4bad-4a03-a4e9-e70cd44a2f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:41.597493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fd6a1763-4bad-4a03-a4e9-e70cd44a2f9a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:41.598718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fd6a1763-4bad-4a03-a4e9-e70cd44a2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:41.717988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:41.721277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 689/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:41.759938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c0bd-1236-4e12-bd6a-879ad736a816 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:41.761549 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8b02c0bd-1236-4e12-bd6a-879ad736a816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:41.871391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c0bd-1236-4e12-bd6a-879ad736a816 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:41.921068 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:41.948563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622825c-bc46-4ce5-8b94-f0c7e1b86a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:41.949252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622825c-bc46-4ce5-8b94-f0c7e1b86a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:41.949540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622825c-bc46-4ce5-8b94-f0c7e1b86a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:41.949820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622825c-bc46-4ce5-8b94-f0c7e1b86a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:41.951517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f622825c-bc46-4ce5-8b94-f0c7e1b86a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:42.066593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622825c-bc46-4ce5-8b94-f0c7e1b86a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:42.068055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622825c-bc46-4ce5-8b94-f0c7e1b86a67 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:42.088930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 660/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:47.072844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6a2a-4d99-44b9-aca1-f5f1bdc52b0f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:47.073378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6a2a-4d99-44b9-aca1-f5f1bdc52b0f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:47.073478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6a2a-4d99-44b9-aca1-f5f1bdc52b0f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:47.075072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 690/1350] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:47.080410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920e68-d609-45dc-b732-2773f2bc3e70 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:47.080873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920e68-d609-45dc-b732-2773f2bc3e70 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:47.081028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920e68-d609-45dc-b732-2773f2bc3e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:47.168234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-01920e68-d609-45dc-b732-2773f2bc3e70 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:47.169222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-01920e68-d609-45dc-b732-2773f2bc3e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:47.189764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:47.294267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 661/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:10:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:51.421772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae005-d5f4-4168-be1f-103b335f82ee None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:51.422279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae005-d5f4-4168-be1f-103b335f82ee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:51.422360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae005-d5f4-4168-be1f-103b335f82ee None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:51.423945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 691/1352] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:51.428856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7e51-5280-4dba-a2d1-311231252643 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:51.429471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7e51-5280-4dba-a2d1-311231252643 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:51.429471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7e51-5280-4dba-a2d1-311231252643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:51.521593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-242b7e51-5280-4dba-a2d1-311231252643 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:51.523337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-242b7e51-5280-4dba-a2d1-311231252643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:51.596626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:51.637069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 662/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:10:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:53.087994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1c67-efc8-441c-8fc4-6fdd8517834b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:53.088558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1c67-efc8-441c-8fc4-6fdd8517834b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:53.088558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1c67-efc8-441c-8fc4-6fdd8517834b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:53.089973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 692/1354] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:53.095191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59f60-c0b0-4cd9-be53-591926c70a21 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:53.095624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59f60-c0b0-4cd9-be53-591926c70a21 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:53.095739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59f60-c0b0-4cd9-be53-591926c70a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:53.173508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b9f59f60-c0b0-4cd9-be53-591926c70a21 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:53.174723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b9f59f60-c0b0-4cd9-be53-591926c70a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:53.280366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 663/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:10:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:10:56.732439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccbcb-fc04-4538-93ee-9efec383074c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:56.733576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccbcb-fc04-4538-93ee-9efec383074c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:56.734095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efccbcb-fc04-4538-93ee-9efec383074c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:56.737243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 693/1356] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:56.744572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518b0b-d1bc-47a8-9987-d78892018b71 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:56.745142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518b0b-d1bc-47a8-9987-d78892018b71 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:56.745142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518b0b-d1bc-47a8-9987-d78892018b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:56.788563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:56.827454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d9518b0b-d1bc-47a8-9987-d78892018b71 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:56.829301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d9518b0b-d1bc-47a8-9987-d78892018b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:56.934972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 664/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:56.991933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770144-d802-4977-bcf8-6f8090f07849 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:56.992993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770144-d802-4977-bcf8-6f8090f07849 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:56.993348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770144-d802-4977-bcf8-6f8090f07849 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:56.995368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 694/1358] 10.222.0.45 () {54 vars in 962 bytes} [Thu Jul 21 04:10:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:57.004544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce322-6f99-4db1-b4ba-501bcbf5fa54 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:57.004881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce322-6f99-4db1-b4ba-501bcbf5fa54 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:57.005207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce322-6f99-4db1-b4ba-501bcbf5fa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:57.086503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0e0ce322-6f99-4db1-b4ba-501bcbf5fa54 None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:57.087716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e0ce322-6f99-4db1-b4ba-501bcbf5fa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:57.139660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:57.224559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 665/1359] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Jul 21 04:10:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:57.233256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770144-d802-4977-bcf8-6f8090f07849 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:57.234784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82770144-d802-4977-bcf8-6f8090f07849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:57.390833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770144-d802-4977-bcf8-6f8090f07849 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:57.468042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:57.518803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10ecd5-537c-414d-bb1e-883277e4fe43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:57.519849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10ecd5-537c-414d-bb1e-883277e4fe43 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:57.520348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10ecd5-537c-414d-bb1e-883277e4fe43 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:57.520870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10ecd5-537c-414d-bb1e-883277e4fe43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:57.523424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b10ecd5-537c-414d-bb1e-883277e4fe43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:57.624226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10ecd5-537c-414d-bb1e-883277e4fe43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:57.626121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10ecd5-537c-414d-bb1e-883277e4fe43 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:57.645477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 695/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:59.897617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f45fe-8eac-4272-bb55-659a677fd9b0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:59.898158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f45fe-8eac-4272-bb55-659a677fd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:59.898268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f45fe-8eac-4272-bb55-659a677fd9b0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:59.899586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 666/1361] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:59.905397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591face4-99b7-4eed-9c08-0e69d2fd674a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:59.906239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591face4-99b7-4eed-9c08-0e69d2fd674a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:59.906531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591face4-99b7-4eed-9c08-0e69d2fd674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:59.975228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-591face4-99b7-4eed-9c08-0e69d2fd674a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:59.976415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-591face4-99b7-4eed-9c08-0e69d2fd674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.017196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:00.083386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 696/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:00.130927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f45fe-8eac-4272-bb55-659a677fd9b0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:00.133257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-504f45fe-8eac-4272-bb55-659a677fd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.305337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f45fe-8eac-4272-bb55-659a677fd9b0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:00.315505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:00.438771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf7f0f-38c5-4f96-9763-aaec5f282cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:00.439533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7f0f-38c5-4f96-9763-aaec5f282cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:00.439713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7f0f-38c5-4f96-9763-aaec5f282cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:00.440038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7f0f-38c5-4f96-9763-aaec5f282cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:00.441787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6bdf7f0f-38c5-4f96-9763-aaec5f282cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.543224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf7f0f-38c5-4f96-9763-aaec5f282cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:00.545136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf7f0f-38c5-4f96-9763-aaec5f282cf2 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:00.565461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 667/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:02.963780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd66d4-291b-443a-ae01-4e8eeaad5eb2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:02.964283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd66d4-291b-443a-ae01-4e8eeaad5eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:02.964283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd66d4-291b-443a-ae01-4e8eeaad5eb2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:02.965789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 697/1364] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:02.971449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf92c-cb6e-4c20-a261-af903693e246 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:02.971870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf92c-cb6e-4c20-a261-af903693e246 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:02.972057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf92c-cb6e-4c20-a261-af903693e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:02.989760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:03.056566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3adbf92c-cb6e-4c20-a261-af903693e246 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:03.057945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3adbf92c-cb6e-4c20-a261-af903693e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:03.166820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 668/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:03.214857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0341c3-d768-4f0f-85b7-6ba632647c55 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:03.215108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0341c3-d768-4f0f-85b7-6ba632647c55 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:03.215937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0341c3-d768-4f0f-85b7-6ba632647c55 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:03.218033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 698/1366] 10.222.0.45 () {54 vars in 962 bytes} [Thu Jul 21 04:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:03.223385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ac2e3-284f-4643-8806-21c3508fcb3c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:03.223684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ac2e3-284f-4643-8806-21c3508fcb3c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:03.223972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ac2e3-284f-4643-8806-21c3508fcb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:03.309172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-654ac2e3-284f-4643-8806-21c3508fcb3c None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:03.310392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-654ac2e3-284f-4643-8806-21c3508fcb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:03.347714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:03.437292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 669/1367] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Jul 21 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:03.444960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0341c3-d768-4f0f-85b7-6ba632647c55 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:03.446486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ae0341c3-d768-4f0f-85b7-6ba632647c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:03.605873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0341c3-d768-4f0f-85b7-6ba632647c55 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:03.627102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:03.734262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e69cb-2c08-4d82-8e49-6fef472a89f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:03.735184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e69cb-2c08-4d82-8e49-6fef472a89f7 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:03.735472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e69cb-2c08-4d82-8e49-6fef472a89f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:03.735752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e69cb-2c08-4d82-8e49-6fef472a89f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:03.737430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-461e69cb-2c08-4d82-8e49-6fef472a89f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:03.832343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e69cb-2c08-4d82-8e49-6fef472a89f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:03.834829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e69cb-2c08-4d82-8e49-6fef472a89f7 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:03.855640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 699/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:04.943695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b104a7-10cd-47bb-acbc-45f9c2172013 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:04.944229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b104a7-10cd-47bb-acbc-45f9c2172013 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:04.944324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b104a7-10cd-47bb-acbc-45f9c2172013 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:04.945890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 670/1369] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:04.950925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b75f5-85db-4008-b40d-e8c10d2e0bbc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:04.951376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b75f5-85db-4008-b40d-e8c10d2e0bbc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:04.951499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b75f5-85db-4008-b40d-e8c10d2e0bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:04.984370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:05.024945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e91b75f5-85db-4008-b40d-e8c10d2e0bbc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:05.026048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e91b75f5-85db-4008-b40d-e8c10d2e0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:05.132081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 700/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:05.477011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac4a0c-ea52-42c0-b275-cef2afd7aa10 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:05.477308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac4a0c-ea52-42c0-b275-cef2afd7aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:05.477596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac4a0c-ea52-42c0-b275-cef2afd7aa10 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:05.479108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 671/1371] 10.222.0.45 () {54 vars in 964 bytes} [Thu Jul 21 04:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:05.483843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc20a85-2058-4e48-98f9-cf5360d3ae08 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:05.484140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc20a85-2058-4e48-98f9-cf5360d3ae08 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:05.484427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc20a85-2058-4e48-98f9-cf5360d3ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:05.565383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1cc20a85-2058-4e48-98f9-cf5360d3ae08 None None] MFA Rules not processed for user `473f1bd4a95f4899a4a9a9927f14738c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:05.566602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1cc20a85-2058-4e48-98f9-cf5360d3ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:05.617051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:05.649358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 701/1372] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Jul 21 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:05.656855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac4a0c-ea52-42c0-b275-cef2afd7aa10 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:05.658384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-96ac4a0c-ea52-42c0-b275-cef2afd7aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:05.773240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac4a0c-ea52-42c0-b275-cef2afd7aa10 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:05.816391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:05.854077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88abd87-f2cd-4cd1-ab89-3ad4cd1a14b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:05.854758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abd87-f2cd-4cd1-ab89-3ad4cd1a14b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:05.855043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abd87-f2cd-4cd1-ab89-3ad4cd1a14b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:05.855325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abd87-f2cd-4cd1-ab89-3ad4cd1a14b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:05.857073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e88abd87-f2cd-4cd1-ab89-3ad4cd1a14b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:05.972846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88abd87-f2cd-4cd1-ab89-3ad4cd1a14b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:05.974950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88abd87-f2cd-4cd1-ab89-3ad4cd1a14b4 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:05.997489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 672/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:06.010105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b11c-acf8-4aae-b94a-5f5e35696901 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:06.010592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b11c-acf8-4aae-b94a-5f5e35696901 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:06.010963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b11c-acf8-4aae-b94a-5f5e35696901 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:06.012865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 702/1374] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:06.017587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bea20c-42a5-46ab-aaa6-691a957c96d7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:06.017983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bea20c-42a5-46ab-aaa6-691a957c96d7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:06.018138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bea20c-42a5-46ab-aaa6-691a957c96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:06.086604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e4bea20c-42a5-46ab-aaa6-691a957c96d7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:06.087980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e4bea20c-42a5-46ab-aaa6-691a957c96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:06.109406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:06.189162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 673/1375] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:06.237331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b11c-acf8-4aae-b94a-5f5e35696901 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:06.238833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ffb5b11c-acf8-4aae-b94a-5f5e35696901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:06.426005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b11c-acf8-4aae-b94a-5f5e35696901 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:06.483135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:06.547031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8ffa4-22ba-46d9-b00e-8adcd4db1de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:06.547771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ffa4-22ba-46d9-b00e-8adcd4db1de5 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:06.548129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ffa4-22ba-46d9-b00e-8adcd4db1de5 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:06.548416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ffa4-22ba-46d9-b00e-8adcd4db1de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:06.550090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ea8ffa4-22ba-46d9-b00e-8adcd4db1de5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:06.640026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ffa4-22ba-46d9-b00e-8adcd4db1de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:06.641707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ffa4-22ba-46d9-b00e-8adcd4db1de5 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:06.664258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 703/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:08.752891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538e42-6e8f-4298-b0d3-1e5e284d7940 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:08.753375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538e42-6e8f-4298-b0d3-1e5e284d7940 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:08.753375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538e42-6e8f-4298-b0d3-1e5e284d7940 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:08.754741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 674/1377] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:08.759889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00536ed0-9ba9-4c90-8d0d-5b25b3e72138 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:08.760339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00536ed0-9ba9-4c90-8d0d-5b25b3e72138 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:08.760503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00536ed0-9ba9-4c90-8d0d-5b25b3e72138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:08.828768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-00536ed0-9ba9-4c90-8d0d-5b25b3e72138 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:08.830016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00536ed0-9ba9-4c90-8d0d-5b25b3e72138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:08.837416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:08.940888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 704/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:08.983323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538e42-6e8f-4298-b0d3-1e5e284d7940 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:08.986596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-da538e42-6e8f-4298-b0d3-1e5e284d7940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:09.140534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538e42-6e8f-4298-b0d3-1e5e284d7940 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:09.144059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:09.260072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b93f6-1477-48ba-8322-43a971c18497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:09.260733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b93f6-1477-48ba-8322-43a971c18497 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:09.261104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b93f6-1477-48ba-8322-43a971c18497 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:09.261427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b93f6-1477-48ba-8322-43a971c18497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:09.263092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f32b93f6-1477-48ba-8322-43a971c18497 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:09.367552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b93f6-1477-48ba-8322-43a971c18497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:09.370154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b93f6-1477-48ba-8322-43a971c18497 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:09.390370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 675/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:11.527049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed3227-23e1-48e4-b294-bca23a5a3c71 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:11.527657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed3227-23e1-48e4-b294-bca23a5a3c71 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:11.527657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed3227-23e1-48e4-b294-bca23a5a3c71 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:11.529408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 705/1380] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:11.535445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677f00-1519-4efa-9933-33b9c944c46a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:11.536019 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677f00-1519-4efa-9933-33b9c944c46a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:11.536019 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677f00-1519-4efa-9933-33b9c944c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:11.548376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:11.610529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ac677f00-1519-4efa-9933-33b9c944c46a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:11.611717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ac677f00-1519-4efa-9933-33b9c944c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:11.723777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 676/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:11.768080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed3227-23e1-48e4-b294-bca23a5a3c71 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:11.769968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d6ed3227-23e1-48e4-b294-bca23a5a3c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:11.923488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:11.936625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed3227-23e1-48e4-b294-bca23a5a3c71 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:12.061167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09a819-02db-4e3d-9095-f47fa7990e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:12.061816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a819-02db-4e3d-9095-f47fa7990e7a service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:12.062101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a819-02db-4e3d-9095-f47fa7990e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:12.062379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a819-02db-4e3d-9095-f47fa7990e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:12.064001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7b09a819-02db-4e3d-9095-f47fa7990e7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:12.160872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09a819-02db-4e3d-9095-f47fa7990e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:12.162771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09a819-02db-4e3d-9095-f47fa7990e7a service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:12.173998 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:12.183645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 706/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:14.304902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5764ff2-ced1-4649-9847-8f626128e98d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:14.305450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5764ff2-ced1-4649-9847-8f626128e98d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:14.305450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5764ff2-ced1-4649-9847-8f626128e98d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:14.306816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 677/1383] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:14.312046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a887-4b84-4e39-8352-0a6c3693e015 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:14.312487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a887-4b84-4e39-8352-0a6c3693e015 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:14.312663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a887-4b84-4e39-8352-0a6c3693e015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:14.379439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-89b4a887-4b84-4e39-8352-0a6c3693e015 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:14.381212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89b4a887-4b84-4e39-8352-0a6c3693e015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:14.483598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 707/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:14.527204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5764ff2-ced1-4649-9847-8f626128e98d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:14.529348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a5764ff2-ced1-4649-9847-8f626128e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:14.640876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:14.712476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5764ff2-ced1-4649-9847-8f626128e98d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:14.829897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1a004-ab95-4fd7-815c-b43efc54c2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:14.830552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1a004-ab95-4fd7-815c-b43efc54c2fb service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:14.830843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1a004-ab95-4fd7-815c-b43efc54c2fb service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:14.831123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1a004-ab95-4fd7-815c-b43efc54c2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:14.832796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f3d1a004-ab95-4fd7-815c-b43efc54c2fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:14.885720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:14.930617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1a004-ab95-4fd7-815c-b43efc54c2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:14.932169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1a004-ab95-4fd7-815c-b43efc54c2fb service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:14.951101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 678/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:17.064752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b56a7-b3e1-42d5-8176-f4da3202573d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:17.065320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b56a7-b3e1-42d5-8176-f4da3202573d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:17.065320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b56a7-b3e1-42d5-8176-f4da3202573d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:17.066714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 708/1386] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:17.074622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef6a9-a6b6-48b4-be10-97904bfadb29 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:17.075095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef6a9-a6b6-48b4-be10-97904bfadb29 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:17.075182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef6a9-a6b6-48b4-be10-97904bfadb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:17.143151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4edef6a9-a6b6-48b4-be10-97904bfadb29 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:17.144398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4edef6a9-a6b6-48b4-be10-97904bfadb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:17.268131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 679/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:17.323895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b56a7-b3e1-42d5-8176-f4da3202573d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:17.325992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fd2b56a7-b3e1-42d5-8176-f4da3202573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:17.410760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:17.502356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b56a7-b3e1-42d5-8176-f4da3202573d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:17.635901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb85622-2062-4fbb-aa2e-b544c34e4df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:17.636928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85622-2062-4fbb-aa2e-b544c34e4df7 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:17.637446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85622-2062-4fbb-aa2e-b544c34e4df7 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:17.637814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb85622-2062-4fbb-aa2e-b544c34e4df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:17.639999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7bb85622-2062-4fbb-aa2e-b544c34e4df7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:17.698566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:17.762331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb85622-2062-4fbb-aa2e-b544c34e4df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:17.764502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb85622-2062-4fbb-aa2e-b544c34e4df7 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:17.790636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 709/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:19.913794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a48ed-63b9-4d32-bfc5-d7e2ffe85b77 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:19.914360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a48ed-63b9-4d32-bfc5-d7e2ffe85b77 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:19.914360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a48ed-63b9-4d32-bfc5-d7e2ffe85b77 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:19.915736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 680/1389] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:19.921044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec4bf-6e65-4ce7-a045-44a98cb8dfea None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:19.921486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec4bf-6e65-4ce7-a045-44a98cb8dfea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:19.921570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec4bf-6e65-4ce7-a045-44a98cb8dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:19.986983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-295ec4bf-6e65-4ce7-a045-44a98cb8dfea None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:19.988204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-295ec4bf-6e65-4ce7-a045-44a98cb8dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:20.093295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 710/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:20.138288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a48ed-63b9-4d32-bfc5-d7e2ffe85b77 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:20.139798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-487a48ed-63b9-4d32-bfc5-d7e2ffe85b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:20.171384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:20.294447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a48ed-63b9-4d32-bfc5-d7e2ffe85b77 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:20.398557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:20.411491 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee68f-55ce-48a7-8cf0-d8ba6395c13b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:20.412511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee68f-55ce-48a7-8cf0-d8ba6395c13b service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:20.412798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee68f-55ce-48a7-8cf0-d8ba6395c13b service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:20.413107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee68f-55ce-48a7-8cf0-d8ba6395c13b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:20.414757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-14eee68f-55ce-48a7-8cf0-d8ba6395c13b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:20.507131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee68f-55ce-48a7-8cf0-d8ba6395c13b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:20.508763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee68f-55ce-48a7-8cf0-d8ba6395c13b service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:20.527259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 681/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:21.120078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065aac-932d-4e4f-8f8d-ee07ef341926 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:21.120685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065aac-932d-4e4f-8f8d-ee07ef341926 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:21.120685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065aac-932d-4e4f-8f8d-ee07ef341926 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:21.122056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 711/1392] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:21.127351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188840-c936-4487-8677-a0229c786c7d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:21.127762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188840-c936-4487-8677-a0229c786c7d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:21.128034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188840-c936-4487-8677-a0229c786c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:21.192745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fe188840-c936-4487-8677-a0229c786c7d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:21.193998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fe188840-c936-4487-8677-a0229c786c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:21.256586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:21.297713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 682/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:21.353400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9afa2-94ae-4c5e-bed8-fba938308fc2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:21.353764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9afa2-94ae-4c5e-bed8-fba938308fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:21.354113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9afa2-94ae-4c5e-bed8-fba938308fc2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:21.355579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 712/1394] 10.222.0.45 () {54 vars in 966 bytes} [Thu Jul 21 04:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:21.361006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e99e-a94e-4428-b90b-ff37f591dcc3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:21.361303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e99e-a94e-4428-b90b-ff37f591dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:21.361594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9e99e-a94e-4428-b90b-ff37f591dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:21.438702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-63a9e99e-a94e-4428-b90b-ff37f591dcc3 None None] MFA Rules not processed for user `061cc3a23d944f18b311eb2aa9a651d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:21.439879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-63a9e99e-a94e-4428-b90b-ff37f591dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:21.515261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 683/1395] 10.222.0.45 () {58 vars in 1063 bytes} [Thu Jul 21 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:21.523527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9afa2-94ae-4c5e-bed8-fba938308fc2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:21.525148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ab9afa2-94ae-4c5e-bed8-fba938308fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:21.539482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:21.631529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9afa2-94ae-4c5e-bed8-fba938308fc2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:21.709519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe82ad-f10d-42f6-9b3c-9704ebffb9cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:21.710087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe82ad-f10d-42f6-9b3c-9704ebffb9cc service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:21.710370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe82ad-f10d-42f6-9b3c-9704ebffb9cc service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:21.710649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe82ad-f10d-42f6-9b3c-9704ebffb9cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:21.712293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4fe82ad-f10d-42f6-9b3c-9704ebffb9cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:21.782466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:21.825423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe82ad-f10d-42f6-9b3c-9704ebffb9cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:21.826895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe82ad-f10d-42f6-9b3c-9704ebffb9cc service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:21.844943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 713/1396] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:22.560694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96796b8-fb36-46ad-b6b3-08bf32c9b55b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:22.561262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96796b8-fb36-46ad-b6b3-08bf32c9b55b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:22.561403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96796b8-fb36-46ad-b6b3-08bf32c9b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:22.607895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e43da0-6256-4622-8da4-f7df1ac4e088 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:22.608492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e43da0-6256-4622-8da4-f7df1ac4e088 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:22.608492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e43da0-6256-4622-8da4-f7df1ac4e088 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:22.610292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 714/1397] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:11:22.615147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:22.615449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:22.615737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:22.628496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f96796b8-fb36-46ad-b6b3-08bf32c9b55b None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:22.630361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f96796b8-fb36-46ad-b6b3-08bf32c9b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:22.638561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:22.689624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:22.690847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:22.718788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 684/1398] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:22.763758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9413d-29b4-4dce-a52f-56246041398c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:22.764058 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9413d-29b4-4dce-a52f-56246041398c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:22.764585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9413d-29b4-4dce-a52f-56246041398c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:22.765732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 685/1399] 10.222.0.45 () {54 vars in 943 bytes} [Thu Jul 21 04:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:11:22.772486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76876-c59f-4d08-827d-6b1e8caf513f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:22.772904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76876-c59f-4d08-827d-6b1e8caf513f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:22.773258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76876-c59f-4d08-827d-6b1e8caf513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:22.793829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 715/1400] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:22.841944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:22.843601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:22.860306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-16b76876-c59f-4d08-827d-6b1e8caf513f None None] MFA Rules not processed for user `65e73243951044e4b5beb3de4ebb0a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:22.861688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-16b76876-c59f-4d08-827d-6b1e8caf513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:22.874912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:22.957090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:22.974645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1915a-61a2-400f-825a-593e7e9fe30e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:22.981523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 686/1401] 10.222.0.45 () {58 vars in 1040 bytes} [Thu Jul 21 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:22.991129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76876-c59f-4d08-827d-6b1e8caf513f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:23.000740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76876-c59f-4d08-827d-6b1e8caf513f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:23.092626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e3cad-4a6e-4dac-949d-4a2621f42627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:23.093223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e3cad-4a6e-4dac-949d-4a2621f42627 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:23.093513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e3cad-4a6e-4dac-949d-4a2621f42627 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:23.093797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e3cad-4a6e-4dac-949d-4a2621f42627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:23.095459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-112e3cad-4a6e-4dac-949d-4a2621f42627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:23.106739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79559b77-5e2f-4009-b4b9-e578d40f445f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:23.107380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559b77-5e2f-4009-b4b9-e578d40f445f service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:23.107669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559b77-5e2f-4009-b4b9-e578d40f445f service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:23.107947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559b77-5e2f-4009-b4b9-e578d40f445f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:23.109908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-79559b77-5e2f-4009-b4b9-e578d40f445f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:23.114729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:23.187781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e3cad-4a6e-4dac-949d-4a2621f42627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:23.189427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e3cad-4a6e-4dac-949d-4a2621f42627 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:23.195820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79559b77-5e2f-4009-b4b9-e578d40f445f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:23.197434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79559b77-5e2f-4009-b4b9-e578d40f445f service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:23.205533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 687/1402] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:11:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 04:11:23.212484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 716/1403] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:25.326619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a013-32d0-497f-8d1f-86b3d23890d1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:25.327179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a013-32d0-497f-8d1f-86b3d23890d1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:25.327179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a013-32d0-497f-8d1f-86b3d23890d1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:25.328602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 688/1404] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:25.334652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce54dd-616f-4bc7-8402-bafb32b2471f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:25.335102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce54dd-616f-4bc7-8402-bafb32b2471f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:25.335301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce54dd-616f-4bc7-8402-bafb32b2471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:25.462398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-13ce54dd-616f-4bc7-8402-bafb32b2471f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:25.463642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-13ce54dd-616f-4bc7-8402-bafb32b2471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:25.569533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:25.577808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 717/1405] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:25.623041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a013-32d0-497f-8d1f-86b3d23890d1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:25.624760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2112a013-32d0-497f-8d1f-86b3d23890d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:25.635267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:25.797428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a013-32d0-497f-8d1f-86b3d23890d1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:25.887488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:25.925428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4765d8-06a6-4ea6-824c-c81b304df8c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:25.926615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4765d8-06a6-4ea6-824c-c81b304df8c3 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:25.926894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4765d8-06a6-4ea6-824c-c81b304df8c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:25.927177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4765d8-06a6-4ea6-824c-c81b304df8c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:25.928859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7e4765d8-06a6-4ea6-824c-c81b304df8c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:26.029797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4765d8-06a6-4ea6-824c-c81b304df8c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:26.031545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4765d8-06a6-4ea6-824c-c81b304df8c3 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:26.059751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 689/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:28.257153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983690-9088-40f6-b13c-a063478c721d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:28.257734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983690-9088-40f6-b13c-a063478c721d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:28.257734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983690-9088-40f6-b13c-a063478c721d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:28.259099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 718/1407] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:28.264434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672cb6-702d-4dd6-895b-f24169ce0e8a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:28.264887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672cb6-702d-4dd6-895b-f24169ce0e8a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:28.265158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672cb6-702d-4dd6-895b-f24169ce0e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:28.342533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-62672cb6-702d-4dd6-895b-f24169ce0e8a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:28.343873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-62672cb6-702d-4dd6-895b-f24169ce0e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:28.396849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:28.463745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 690/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:28.510044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983690-9088-40f6-b13c-a063478c721d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:28.511385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cb983690-9088-40f6-b13c-a063478c721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:28.684515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983690-9088-40f6-b13c-a063478c721d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:28.758725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:28.811477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812f2b4-88fc-49aa-b089-d3a82e9e44de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:28.812041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812f2b4-88fc-49aa-b089-d3a82e9e44de service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:28.812326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812f2b4-88fc-49aa-b089-d3a82e9e44de service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:28.812606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812f2b4-88fc-49aa-b089-d3a82e9e44de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:28.814315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5812f2b4-88fc-49aa-b089-d3a82e9e44de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:28.914734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812f2b4-88fc-49aa-b089-d3a82e9e44de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:28.916367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812f2b4-88fc-49aa-b089-d3a82e9e44de service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:28.936324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 719/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:38.461907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=23 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:38.933615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=64 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:45.748197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7798-6546-445e-baa9-b945136a8816 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:45.748768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7798-6546-445e-baa9-b945136a8816 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:45.748768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7798-6546-445e-baa9-b945136a8816 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:45.750159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 691/1410] 10.222.0.45 () {54 vars in 918 bytes} [Thu Jul 21 04:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:45.755778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a685026-5651-45d6-bdb9-ded967a9610b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:45.756224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a685026-5651-45d6-bdb9-ded967a9610b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:45.756364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a685026-5651-45d6-bdb9-ded967a9610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:45.829727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3a685026-5651-45d6-bdb9-ded967a9610b None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:45.831541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a685026-5651-45d6-bdb9-ded967a9610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:45.936805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 720/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:45.951657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced788-564a-421d-9596-6ff9ecebc65c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:45.951949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced788-564a-421d-9596-6ff9ecebc65c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:45.952230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced788-564a-421d-9596-6ff9ecebc65c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:45.953639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 692/1412] 10.222.0.45 () {54 vars in 918 bytes} [Thu Jul 21 04:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:45.958791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09604-8516-4374-9a3b-4de933bfde0c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:45.959110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09604-8516-4374-9a3b-4de933bfde0c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:45.959380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09604-8516-4374-9a3b-4de933bfde0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:46.031097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:46.033927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-18c09604-8516-4374-9a3b-4de933bfde0c None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:46.035719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-18c09604-8516-4374-9a3b-4de933bfde0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:46.154562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 721/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:48.639693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68da89-94ed-4e68-a8c5-7f18ed366a34 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:48.639693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68da89-94ed-4e68-a8c5-7f18ed366a34 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:48.639693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68da89-94ed-4e68-a8c5-7f18ed366a34 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:48.640440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:48.645958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234783dc-7350-4b0c-8bcf-684f1a89d9bc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:48.646452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234783dc-7350-4b0c-8bcf-684f1a89d9bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:48.646566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234783dc-7350-4b0c-8bcf-684f1a89d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:48.721742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-234783dc-7350-4b0c-8bcf-684f1a89d9bc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:48.722918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-234783dc-7350-4b0c-8bcf-684f1a89d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:48.779532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:48.823595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:48.867954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68da89-94ed-4e68-a8c5-7f18ed366a34 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:48.869633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7e68da89-94ed-4e68-a8c5-7f18ed366a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:49.015031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68da89-94ed-4e68-a8c5-7f18ed366a34 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:49.087298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:49.128041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef867bcb-42d7-471c-a1c2-1c88d72dd56e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:49.128685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef867bcb-42d7-471c-a1c2-1c88d72dd56e service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:49.128999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef867bcb-42d7-471c-a1c2-1c88d72dd56e service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:49.129279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef867bcb-42d7-471c-a1c2-1c88d72dd56e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:49.130925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ef867bcb-42d7-471c-a1c2-1c88d72dd56e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:49.218995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef867bcb-42d7-471c-a1c2-1c88d72dd56e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:49.220609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef867bcb-42d7-471c-a1c2-1c88d72dd56e service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:49.239309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 694/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:50.141748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea7b5-c275-4cc3-bf89-a6cbde4bb737 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:50.142327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea7b5-c275-4cc3-bf89-a6cbde4bb737 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:50.142327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea7b5-c275-4cc3-bf89-a6cbde4bb737 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:50.143692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:50.148703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663504-f39d-4de2-adb6-9c4836e5e689 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:50.149182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663504-f39d-4de2-adb6-9c4836e5e689 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:50.149319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663504-f39d-4de2-adb6-9c4836e5e689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:50.224891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-00663504-f39d-4de2-adb6-9c4836e5e689 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:50.226129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-00663504-f39d-4de2-adb6-9c4836e5e689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:50.253434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:50.326958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:50.476484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ea7b5-c275-4cc3-bf89-a6cbde4bb737 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:50.478065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff1ea7b5-c275-4cc3-bf89-a6cbde4bb737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:50.624086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ea7b5-c275-4cc3-bf89-a6cbde4bb737 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:50.664382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:50.737546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df3872-4839-4791-a61e-ecf8f7ab6f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:50.738119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df3872-4839-4791-a61e-ecf8f7ab6f5c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:50.738402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df3872-4839-4791-a61e-ecf8f7ab6f5c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:50.738677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df3872-4839-4791-a61e-ecf8f7ab6f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:50.740327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00df3872-4839-4791-a61e-ecf8f7ab6f5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:50.828469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df3872-4839-4791-a61e-ecf8f7ab6f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:50.830112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df3872-4839-4791-a61e-ecf8f7ab6f5c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:50.848985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 724/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:51.734606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d042c6e-5358-4010-bfa0-5bfac84e3177 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:51.735171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d042c6e-5358-4010-bfa0-5bfac84e3177 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:51.735171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d042c6e-5358-4010-bfa0-5bfac84e3177 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:51.736676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:51.741929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337ca7c-cb70-4823-9234-58fabd6b4792 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:51.742341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337ca7c-cb70-4823-9234-58fabd6b4792 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:51.742505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337ca7c-cb70-4823-9234-58fabd6b4792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:51.795031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:51.818344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1337ca7c-cb70-4823-9234-58fabd6b4792 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:51.819585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1337ca7c-cb70-4823-9234-58fabd6b4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:51.917772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:52.067557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d042c6e-5358-4010-bfa0-5bfac84e3177 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:52.069345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9d042c6e-5358-4010-bfa0-5bfac84e3177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:52.216461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d042c6e-5358-4010-bfa0-5bfac84e3177 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:52.231230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:52.333211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c5261-806d-40a1-8900-8bab3031b302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:52.333859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5261-806d-40a1-8900-8bab3031b302 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:52.334146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5261-806d-40a1-8900-8bab3031b302 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:52.334426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c5261-806d-40a1-8900-8bab3031b302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:52.336080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c79c5261-806d-40a1-8900-8bab3031b302 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:52.434173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c5261-806d-40a1-8900-8bab3031b302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:52.435802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c5261-806d-40a1-8900-8bab3031b302 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:52.454184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 697/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:53.311673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5d17-cb8c-46da-81dd-66793f95489a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:53.312278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5d17-cb8c-46da-81dd-66793f95489a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:53.312278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b5d17-cb8c-46da-81dd-66793f95489a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:53.313648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:53.319142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540e2a6-638b-443e-82d2-e4b229c497fc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:53.319617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540e2a6-638b-443e-82d2-e4b229c497fc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:53.319711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540e2a6-638b-443e-82d2-e4b229c497fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:53.338050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:53.513060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5540e2a6-638b-443e-82d2-e4b229c497fc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:53.514285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5540e2a6-638b-443e-82d2-e4b229c497fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:53.610599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:53.764607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b5d17-cb8c-46da-81dd-66793f95489a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:53.766173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-501b5d17-cb8c-46da-81dd-66793f95489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:53.877537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:53.914568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b5d17-cb8c-46da-81dd-66793f95489a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:54.027591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba8976-74a3-4c39-a2d4-9499e9410b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:54.028252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8976-74a3-4c39-a2d4-9499e9410b31 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:54.028523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8976-74a3-4c39-a2d4-9499e9410b31 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:54.028805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8976-74a3-4c39-a2d4-9499e9410b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:54.030506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ceba8976-74a3-4c39-a2d4-9499e9410b31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:54.107807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:54.122348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba8976-74a3-4c39-a2d4-9499e9410b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:54.123981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba8976-74a3-4c39-a2d4-9499e9410b31 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:54.144909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 727/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:55.007962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454de39-a8fd-415e-951b-d5de1465ba80 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:55.008531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454de39-a8fd-415e-951b-d5de1465ba80 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:55.008640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454de39-a8fd-415e-951b-d5de1465ba80 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:55.009990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:55.014833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53ae8-a416-4563-b395-6fa9bf1e3ec8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:55.015305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53ae8-a416-4563-b395-6fa9bf1e3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:55.015412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53ae8-a416-4563-b395-6fa9bf1e3ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:55.089528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b8b53ae8-a416-4563-b395-6fa9bf1e3ec8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:55.090818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b8b53ae8-a416-4563-b395-6fa9bf1e3ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:55.188280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:55.339524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454de39-a8fd-415e-951b-d5de1465ba80 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:55.341098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f454de39-a8fd-415e-951b-d5de1465ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:55.426374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:55.488672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454de39-a8fd-415e-951b-d5de1465ba80 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:55.597932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fb61-bc58-4f9a-b38b-4a62bb82cf38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:55.598520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fb61-bc58-4f9a-b38b-4a62bb82cf38 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:55.598782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fb61-bc58-4f9a-b38b-4a62bb82cf38 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:55.599059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fb61-bc58-4f9a-b38b-4a62bb82cf38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:55.600700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c479fb61-bc58-4f9a-b38b-4a62bb82cf38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:55.648272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:55.690497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fb61-bc58-4f9a-b38b-4a62bb82cf38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:55.692100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fb61-bc58-4f9a-b38b-4a62bb82cf38 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:55.710162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 700/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:56.525664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa7299-5e72-43f6-b9ad-9c70508228f5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:56.526222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa7299-5e72-43f6-b9ad-9c70508228f5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:56.526222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa7299-5e72-43f6-b9ad-9c70508228f5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:56.527662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:56.532676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b9bc-ced3-47c0-ba96-7e24d1d4442d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:56.533177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b9bc-ced3-47c0-ba96-7e24d1d4442d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:56.533428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b9bc-ced3-47c0-ba96-7e24d1d4442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:56.606618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b913b9bc-ced3-47c0-ba96-7e24d1d4442d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:56.608104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b913b9bc-ced3-47c0-ba96-7e24d1d4442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:56.706025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:56.859082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa7299-5e72-43f6-b9ad-9c70508228f5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:56.860599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9efa7299-5e72-43f6-b9ad-9c70508228f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:56.910200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:57.007325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa7299-5e72-43f6-b9ad-9c70508228f5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:57.118704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42d117-f488-44ce-a57a-18d94fbafbea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:57.119275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d117-f488-44ce-a57a-18d94fbafbea service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:57.119556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d117-f488-44ce-a57a-18d94fbafbea service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:57.119830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d117-f488-44ce-a57a-18d94fbafbea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:57.121484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bf42d117-f488-44ce-a57a-18d94fbafbea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:57.128548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:57.213781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42d117-f488-44ce-a57a-18d94fbafbea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:57.215378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42d117-f488-44ce-a57a-18d94fbafbea service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:57.234342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 730/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:58.040034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6fd2f-699e-4c24-ba87-93c069900624 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:58.040606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6fd2f-699e-4c24-ba87-93c069900624 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:58.040606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6fd2f-699e-4c24-ba87-93c069900624 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:58.041983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:58.046918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16cc2e-2448-486c-a709-81ef354fb70b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:58.047367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16cc2e-2448-486c-a709-81ef354fb70b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:58.047472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16cc2e-2448-486c-a709-81ef354fb70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:58.122867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5c16cc2e-2448-486c-a709-81ef354fb70b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:58.124077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c16cc2e-2448-486c-a709-81ef354fb70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:58.192660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:58.221972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:58.373365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6fd2f-699e-4c24-ba87-93c069900624 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:58.374852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9cf6fd2f-699e-4c24-ba87-93c069900624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:58.393686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:58.520689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6fd2f-699e-4c24-ba87-93c069900624 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:58.605302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:58.633567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ced290-2028-45d6-aa92-0cd1a808a71b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:58.634229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ced290-2028-45d6-aa92-0cd1a808a71b service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:58.634703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ced290-2028-45d6-aa92-0cd1a808a71b service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:58.634999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ced290-2028-45d6-aa92-0cd1a808a71b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:58.637072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-29ced290-2028-45d6-aa92-0cd1a808a71b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:58.731537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ced290-2028-45d6-aa92-0cd1a808a71b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:58.733696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ced290-2028-45d6-aa92-0cd1a808a71b service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:58.753180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 703/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:59.554641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487330dc-49c1-438e-80dc-3c280eb9d9b5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:59.555197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487330dc-49c1-438e-80dc-3c280eb9d9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:59.555197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487330dc-49c1-438e-80dc-3c280eb9d9b5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:59.556603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:59.561448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500c60-4602-46f6-841f-94555070c44c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:59.561909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500c60-4602-46f6-841f-94555070c44c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:59.562029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500c60-4602-46f6-841f-94555070c44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:59.635941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-99500c60-4602-46f6-841f-94555070c44c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:59.637175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-99500c60-4602-46f6-841f-94555070c44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:59.679416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:59.735065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:59.887627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487330dc-49c1-438e-80dc-3c280eb9d9b5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:59.889207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-487330dc-49c1-438e-80dc-3c280eb9d9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:00.036138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487330dc-49c1-438e-80dc-3c280eb9d9b5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:00.089454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:00.147574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a6440-89ef-4421-8dce-23be65f9a1fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:00.148151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a6440-89ef-4421-8dce-23be65f9a1fc service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:00.148435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a6440-89ef-4421-8dce-23be65f9a1fc service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:00.148715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a6440-89ef-4421-8dce-23be65f9a1fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:00.150419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aa5a6440-89ef-4421-8dce-23be65f9a1fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:00.245543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a6440-89ef-4421-8dce-23be65f9a1fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:00.247222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a6440-89ef-4421-8dce-23be65f9a1fc service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:00.265370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 733/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:01.075682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08800fb-7a63-4b3e-be66-e522cd4f94b6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:01.076224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08800fb-7a63-4b3e-be66-e522cd4f94b6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:01.076224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08800fb-7a63-4b3e-be66-e522cd4f94b6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:01.077627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:01.083306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2628d-51dd-4ef7-8232-cdf26580e5df None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:01.083731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2628d-51dd-4ef7-8232-cdf26580e5df None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:01.083876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2628d-51dd-4ef7-8232-cdf26580e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:01.157368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-21b2628d-51dd-4ef7-8232-cdf26580e5df None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:01.158724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21b2628d-51dd-4ef7-8232-cdf26580e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:01.160747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:01.261010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:01.412542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08800fb-7a63-4b3e-be66-e522cd4f94b6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:01.414148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d08800fb-7a63-4b3e-be66-e522cd4f94b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:01.560793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08800fb-7a63-4b3e-be66-e522cd4f94b6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:01.587572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:01.677128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04732bd-ce8d-4117-8f54-396641aa6ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:01.677786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04732bd-ce8d-4117-8f54-396641aa6ff9 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:01.678070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04732bd-ce8d-4117-8f54-396641aa6ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:01.678348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04732bd-ce8d-4117-8f54-396641aa6ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:01.680010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d04732bd-ce8d-4117-8f54-396641aa6ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:01.769329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04732bd-ce8d-4117-8f54-396641aa6ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:01.770953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04732bd-ce8d-4117-8f54-396641aa6ff9 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:01.789639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 706/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:03.739603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd1e4-19b8-4ab6-a2d6-8145c845bb0a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:03.740146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd1e4-19b8-4ab6-a2d6-8145c845bb0a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:03.740146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd1e4-19b8-4ab6-a2d6-8145c845bb0a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:03.741587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:03.746878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbca2-7b05-4878-91db-36f7a05debf0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:03.747322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbca2-7b05-4878-91db-36f7a05debf0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:03.747434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbca2-7b05-4878-91db-36f7a05debf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:03.788003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:03.812745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ee5bbca2-7b05-4878-91db-36f7a05debf0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:03.813988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee5bbca2-7b05-4878-91db-36f7a05debf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:03.910919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:03.949494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cd1e4-19b8-4ab6-a2d6-8145c845bb0a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:03.951070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a20cd1e4-19b8-4ab6-a2d6-8145c845bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:04.056339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cd1e4-19b8-4ab6-a2d6-8145c845bb0a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:04.088666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:04.131576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc0d1e-49fe-4c23-97c3-d6e9def85050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:04.132227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0d1e-49fe-4c23-97c3-d6e9def85050 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:04.132502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0d1e-49fe-4c23-97c3-d6e9def85050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:04.132776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc0d1e-49fe-4c23-97c3-d6e9def85050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:04.134440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9fdc0d1e-49fe-4c23-97c3-d6e9def85050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:04.244756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc0d1e-49fe-4c23-97c3-d6e9def85050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:04.246154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc0d1e-49fe-4c23-97c3-d6e9def85050 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:04.265741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 736/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:06.458226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b20a8-fc99-4ec7-8424-3c4b5b21523b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:06.458803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b20a8-fc99-4ec7-8424-3c4b5b21523b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:06.458803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b20a8-fc99-4ec7-8424-3c4b5b21523b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:06.460138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:06.465362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660cde-53a0-4562-b6b8-8e77c08a8a7d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:06.465809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660cde-53a0-4562-b6b8-8e77c08a8a7d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:06.466040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660cde-53a0-4562-b6b8-8e77c08a8a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:06.531833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a8660cde-53a0-4562-b6b8-8e77c08a8a7d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:06.533113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a8660cde-53a0-4562-b6b8-8e77c08a8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:06.545938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:06.630096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:06.668228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b20a8-fc99-4ec7-8424-3c4b5b21523b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:06.671089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2c9b20a8-fc99-4ec7-8424-3c4b5b21523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:06.779523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b20a8-fc99-4ec7-8424-3c4b5b21523b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:06.793144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:06.855980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7eed-c3fb-45c6-adf3-fbd2cb318ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:06.856628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7eed-c3fb-45c6-adf3-fbd2cb318ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:06.856940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7eed-c3fb-45c6-adf3-fbd2cb318ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:06.857222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7eed-c3fb-45c6-adf3-fbd2cb318ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:06.859123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a2bb7eed-c3fb-45c6-adf3-fbd2cb318ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:06.970691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7eed-c3fb-45c6-adf3-fbd2cb318ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:06.972142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7eed-c3fb-45c6-adf3-fbd2cb318ca7 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:06.990974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 709/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:12:09.350886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95cf1-3154-40b2-a2a6-2b41278ff03a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:09.351460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95cf1-3154-40b2-a2a6-2b41278ff03a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:09.351460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95cf1-3154-40b2-a2a6-2b41278ff03a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:09.352869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:09.358941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac9f5-4e5b-4317-a3be-698d30715a2c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:09.359331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac9f5-4e5b-4317-a3be-698d30715a2c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:09.359506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac9f5-4e5b-4317-a3be-698d30715a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:09.406719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:09.426093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-361ac9f5-4e5b-4317-a3be-698d30715a2c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:09.427304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-361ac9f5-4e5b-4317-a3be-698d30715a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:09.523354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:09.563055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95cf1-3154-40b2-a2a6-2b41278ff03a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:09.565271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-97e95cf1-3154-40b2-a2a6-2b41278ff03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:09.669756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95cf1-3154-40b2-a2a6-2b41278ff03a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:09.709805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:09.744431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601ef75-821d-43b5-b032-c52ad22cf4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:09.745108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601ef75-821d-43b5-b032-c52ad22cf4fe service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:09.745401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601ef75-821d-43b5-b032-c52ad22cf4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:09.745686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601ef75-821d-43b5-b032-c52ad22cf4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:09.747335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7601ef75-821d-43b5-b032-c52ad22cf4fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:09.858373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601ef75-821d-43b5-b032-c52ad22cf4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:09.860069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601ef75-821d-43b5-b032-c52ad22cf4fe service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:09.878549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 739/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:12.038115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5890ecc-30e1-4ff1-8402-887be7916d85 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:12.038659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5890ecc-30e1-4ff1-8402-887be7916d85 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:12.038659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5890ecc-30e1-4ff1-8402-887be7916d85 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:12.040056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:12.045397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903fd20-907e-4775-bcd0-0839ccba44cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:12.045801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903fd20-907e-4775-bcd0-0839ccba44cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:12.045969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903fd20-907e-4775-bcd0-0839ccba44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:12.113932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e903fd20-907e-4775-bcd0-0839ccba44cc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:12.115135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e903fd20-907e-4775-bcd0-0839ccba44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:12.135980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:12.212906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:12.251549 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5890ecc-30e1-4ff1-8402-887be7916d85 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:12.253949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a5890ecc-30e1-4ff1-8402-887be7916d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:12.355040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5890ecc-30e1-4ff1-8402-887be7916d85 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:12.375619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:12.432880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809c147-cc05-4fdf-b503-11759cba3756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:12.433527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c147-cc05-4fdf-b503-11759cba3756 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:12.433808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c147-cc05-4fdf-b503-11759cba3756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:12.434082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c147-cc05-4fdf-b503-11759cba3756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:12.435722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a809c147-cc05-4fdf-b503-11759cba3756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:12.543195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809c147-cc05-4fdf-b503-11759cba3756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:12.544626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809c147-cc05-4fdf-b503-11759cba3756 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:12.564206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 712/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:14.678914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f38f51-9cbb-4e83-9bdd-0730b87a6736 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:14.679378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f38f51-9cbb-4e83-9bdd-0730b87a6736 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:14.679477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f38f51-9cbb-4e83-9bdd-0730b87a6736 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:14.680905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:14.686057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c79f6-e215-4ec9-b8ca-8df0389e9e15 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:14.686482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c79f6-e215-4ec9-b8ca-8df0389e9e15 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:14.686591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c79f6-e215-4ec9-b8ca-8df0389e9e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:14.749154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:14.752403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-274c79f6-e215-4ec9-b8ca-8df0389e9e15 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:14.753995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-274c79f6-e215-4ec9-b8ca-8df0389e9e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:14.849922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:14.888320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f38f51-9cbb-4e83-9bdd-0730b87a6736 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:14.889925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-83f38f51-9cbb-4e83-9bdd-0730b87a6736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:14.991919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f38f51-9cbb-4e83-9bdd-0730b87a6736 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:15.040633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:15.065361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7ea3d-e4ad-4a2d-b6ff-65e6ba9bac60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:15.066001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ea3d-e4ad-4a2d-b6ff-65e6ba9bac60 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:15.066284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ea3d-e4ad-4a2d-b6ff-65e6ba9bac60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:15.066562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ea3d-e4ad-4a2d-b6ff-65e6ba9bac60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:15.068191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82d7ea3d-e4ad-4a2d-b6ff-65e6ba9bac60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:15.177362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7ea3d-e4ad-4a2d-b6ff-65e6ba9bac60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:15.178810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7ea3d-e4ad-4a2d-b6ff-65e6ba9bac60 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:15.197327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 742/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:17.370394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aeee8-0421-4890-b2ca-2e9c5a6ec394 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:17.370960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aeee8-0421-4890-b2ca-2e9c5a6ec394 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:17.370960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aeee8-0421-4890-b2ca-2e9c5a6ec394 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:17.372332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:17.378024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3c16-3a64-4cc8-838e-ffbdbb1e45e8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:17.378438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3c16-3a64-4cc8-838e-ffbdbb1e45e8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:17.378596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3c16-3a64-4cc8-838e-ffbdbb1e45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:17.443414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-458c3c16-3a64-4cc8-838e-ffbdbb1e45e8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:17.444654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-458c3c16-3a64-4cc8-838e-ffbdbb1e45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:17.474865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:17.542571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:17.581891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aeee8-0421-4890-b2ca-2e9c5a6ec394 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:17.583478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e04aeee8-0421-4890-b2ca-2e9c5a6ec394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:17.687247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aeee8-0421-4890-b2ca-2e9c5a6ec394 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:17.716133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:17.763159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686bdc-9fd9-453f-a163-09b09bb00d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:17.763832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686bdc-9fd9-453f-a163-09b09bb00d3b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:17.764188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686bdc-9fd9-453f-a163-09b09bb00d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:17.764486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686bdc-9fd9-453f-a163-09b09bb00d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:17.766189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1b686bdc-9fd9-453f-a163-09b09bb00d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:17.875441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b686bdc-9fd9-453f-a163-09b09bb00d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:17.876925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b686bdc-9fd9-453f-a163-09b09bb00d3b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:17.897354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 715/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:19.978252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb4c1-cbbb-4c22-a0aa-1d0b56b21e06 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:19.978800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb4c1-cbbb-4c22-a0aa-1d0b56b21e06 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:19.978800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb4c1-cbbb-4c22-a0aa-1d0b56b21e06 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:19.980175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:19.985760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4eb09-436e-42b7-9c48-61e84ae6617d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:19.986173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4eb09-436e-42b7-9c48-61e84ae6617d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:19.986309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4eb09-436e-42b7-9c48-61e84ae6617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:20.049746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f8e4eb09-436e-42b7-9c48-61e84ae6617d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:20.050945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f8e4eb09-436e-42b7-9c48-61e84ae6617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:20.059116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:20.147967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:20.186108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eb4c1-cbbb-4c22-a0aa-1d0b56b21e06 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:20.187645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5f7eb4c1-cbbb-4c22-a0aa-1d0b56b21e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:20.289700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eb4c1-cbbb-4c22-a0aa-1d0b56b21e06 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:20.343646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:20.364043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374818a-cddf-4b5c-a06b-edc921d12497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:20.364699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374818a-cddf-4b5c-a06b-edc921d12497 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:20.365025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374818a-cddf-4b5c-a06b-edc921d12497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:20.365312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374818a-cddf-4b5c-a06b-edc921d12497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:20.366976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4374818a-cddf-4b5c-a06b-edc921d12497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:20.476063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374818a-cddf-4b5c-a06b-edc921d12497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:20.477549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374818a-cddf-4b5c-a06b-edc921d12497 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:20.496622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 745/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:22.580211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06079-cea4-4091-9ab0-c730ee7985a1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:22.581534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06079-cea4-4091-9ab0-c730ee7985a1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:22.581534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06079-cea4-4091-9ab0-c730ee7985a1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:22.582775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:22.588080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a0e13-c2de-42f6-86bd-c4fddcd224cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:22.588483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a0e13-c2de-42f6-86bd-c4fddcd224cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:22.588643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a0e13-c2de-42f6-86bd-c4fddcd224cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:22.654202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-016a0e13-c2de-42f6-86bd-c4fddcd224cc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:22.655397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-016a0e13-c2de-42f6-86bd-c4fddcd224cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:22.694930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:22.759721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:22.796906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06079-cea4-4091-9ab0-c730ee7985a1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:22.798451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f5d06079-cea4-4091-9ab0-c730ee7985a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:22.903850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06079-cea4-4091-9ab0-c730ee7985a1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:22.941237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:22.977813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c47a-06e8-41d4-a807-49bb837ef868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:22.978470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c47a-06e8-41d4-a807-49bb837ef868 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:22.978758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c47a-06e8-41d4-a807-49bb837ef868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:22.979040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c47a-06e8-41d4-a807-49bb837ef868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:22.980704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-75e4c47a-06e8-41d4-a807-49bb837ef868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:23.088662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4c47a-06e8-41d4-a807-49bb837ef868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:23.090289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4c47a-06e8-41d4-a807-49bb837ef868 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:23.109889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 718/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:25.182348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476236-ef7a-497b-8e22-d783e577b2e1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:25.182939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476236-ef7a-497b-8e22-d783e577b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:25.182939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476236-ef7a-497b-8e22-d783e577b2e1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:25.184437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:25.189593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8989-b3fe-49c2-a866-842980c295bf None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:25.190680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8989-b3fe-49c2-a866-842980c295bf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:25.190856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8989-b3fe-49c2-a866-842980c295bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:25.256365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7dbe8989-b3fe-49c2-a866-842980c295bf None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:25.257600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7dbe8989-b3fe-49c2-a866-842980c295bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:25.275389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:25.353112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:25.390453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476236-ef7a-497b-8e22-d783e577b2e1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:25.392001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-67476236-ef7a-497b-8e22-d783e577b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:25.497142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476236-ef7a-497b-8e22-d783e577b2e1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:25.564772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:25.571968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5078f3-aad8-49c6-ab2e-30e7fbe01466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:25.572730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5078f3-aad8-49c6-ab2e-30e7fbe01466 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:25.573052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5078f3-aad8-49c6-ab2e-30e7fbe01466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:25.573333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5078f3-aad8-49c6-ab2e-30e7fbe01466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:25.575063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a5078f3-aad8-49c6-ab2e-30e7fbe01466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:25.683050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5078f3-aad8-49c6-ab2e-30e7fbe01466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:25.684535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5078f3-aad8-49c6-ab2e-30e7fbe01466 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:25.702546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 748/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:27.885738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff51f47-afe1-4ce0-a0aa-ce4b7e1acd4e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:27.886369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff51f47-afe1-4ce0-a0aa-ce4b7e1acd4e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:27.886369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff51f47-afe1-4ce0-a0aa-ce4b7e1acd4e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:27.887695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:27.893099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa067df-f304-45de-a990-85e02c52ae3c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:27.893593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa067df-f304-45de-a990-85e02c52ae3c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:27.893699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa067df-f304-45de-a990-85e02c52ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:27.957951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1aa067df-f304-45de-a990-85e02c52ae3c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:27.959079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1aa067df-f304-45de-a990-85e02c52ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:28.006993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:28.055749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:28.093168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff51f47-afe1-4ce0-a0aa-ce4b7e1acd4e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:28.094717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6ff51f47-afe1-4ce0-a0aa-ce4b7e1acd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:28.198423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff51f47-afe1-4ce0-a0aa-ce4b7e1acd4e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:28.245843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:28.271943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046acc4e-a1f3-435f-b440-eda4d9cdb2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:28.272589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046acc4e-a1f3-435f-b440-eda4d9cdb2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:28.272903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046acc4e-a1f3-435f-b440-eda4d9cdb2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:28.273189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046acc4e-a1f3-435f-b440-eda4d9cdb2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:28.274855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-046acc4e-a1f3-435f-b440-eda4d9cdb2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:28.385118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046acc4e-a1f3-435f-b440-eda4d9cdb2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:28.386573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046acc4e-a1f3-435f-b440-eda4d9cdb2d2 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:28.406436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 721/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:38.053927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=22 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:38.404111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=66 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:48.102963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a80c-8f05-43bc-aa14-d4734c70dc38 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:48.103557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a80c-8f05-43bc-aa14-d4734c70dc38 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:48.103557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a80c-8f05-43bc-aa14-d4734c70dc38 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:48.104999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 750/1471] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:48.110284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dad36-02e6-4fab-ac5e-163735d7ed30 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:48.110967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dad36-02e6-4fab-ac5e-163735d7ed30 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:48.111118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dad36-02e6-4fab-ac5e-163735d7ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:48.176343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e95dad36-02e6-4fab-ac5e-163735d7ed30 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:48.177596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e95dad36-02e6-4fab-ac5e-163735d7ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:48.276334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 722/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:48.360500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01d84-575a-43a1-b437-b92b90d765d4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:48.361084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01d84-575a-43a1-b437-b92b90d765d4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:48.361368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01d84-575a-43a1-b437-b92b90d765d4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:48.363687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 751/1473] 10.222.0.45 () {54 vars in 966 bytes} [Thu Jul 21 04:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:48.368697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154c35-9d38-4ceb-8ec3-32e21daa3a0a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:48.369148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154c35-9d38-4ceb-8ec3-32e21daa3a0a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:48.369438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154c35-9d38-4ceb-8ec3-32e21daa3a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:48.447565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-78154c35-9d38-4ceb-8ec3-32e21daa3a0a None None] MFA Rules not processed for user `061cc3a23d944f18b311eb2aa9a651d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:48.448839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-78154c35-9d38-4ceb-8ec3-32e21daa3a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:48.469171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:48.529837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 723/1474] 10.222.0.45 () {58 vars in 1063 bytes} [Thu Jul 21 04:12:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:48.537463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a01d84-575a-43a1-b437-b92b90d765d4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:48.538990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01a01d84-575a-43a1-b437-b92b90d765d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:48.643000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a01d84-575a-43a1-b437-b92b90d765d4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:48.722820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2c514-4590-4dcb-899f-4296585755f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:48.723463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c514-4590-4dcb-899f-4296585755f2 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:48.723747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c514-4590-4dcb-899f-4296585755f2 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:48.724024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c514-4590-4dcb-899f-4296585755f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:48.725706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0ce2c514-4590-4dcb-899f-4296585755f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:48.780862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:48.838656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2c514-4590-4dcb-899f-4296585755f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:48.840360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2c514-4590-4dcb-899f-4296585755f2 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:48.861294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 752/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:50.997959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f7a7-50f9-43ef-8c89-0ad5628fb504 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:50.998507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f7a7-50f9-43ef-8c89-0ad5628fb504 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:50.998627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f7a7-50f9-43ef-8c89-0ad5628fb504 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:50.999923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 724/1476] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:51.005421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8692-0159-4354-90a9-7556b8560e91 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:51.005856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8692-0159-4354-90a9-7556b8560e91 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:51.006018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb8692-0159-4354-90a9-7556b8560e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:51.070076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4ddb8692-0159-4354-90a9-7556b8560e91 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:51.071288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ddb8692-0159-4354-90a9-7556b8560e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:51.166770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 753/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:51.190715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f7a7-50f9-43ef-8c89-0ad5628fb504 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:51.192255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebc0f7a7-50f9-43ef-8c89-0ad5628fb504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:51.316246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f7a7-50f9-43ef-8c89-0ad5628fb504 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:51.364516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:51.409759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005fa19-7d5c-4908-8d55-e74ab9def321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:51.410422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fa19-7d5c-4908-8d55-e74ab9def321 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:51.410705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fa19-7d5c-4908-8d55-e74ab9def321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:51.410980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fa19-7d5c-4908-8d55-e74ab9def321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:51.411702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005fa19-7d5c-4908-8d55-e74ab9def321 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:51.413454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-f005fa19-7d5c-4908-8d55-e74ab9def321 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:12:51.413454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:12:51.413454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:12:51.414595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005fa19-7d5c-4908-8d55-e74ab9def321 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:51.434747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 725/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Jul 21 04:12:51 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:12:53.501129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fbfc8-580c-4ded-929f-5f36a205af71 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:53.501703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fbfc8-580c-4ded-929f-5f36a205af71 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:53.501703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fbfc8-580c-4ded-929f-5f36a205af71 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:53.503179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 754/1479] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:53.508484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d2b5-623c-417a-ab62-281b3371c1f2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:53.508950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d2b5-623c-417a-ab62-281b3371c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:53.509082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d2b5-623c-417a-ab62-281b3371c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:53.573055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f930d2b5-623c-417a-ab62-281b3371c1f2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:53.574271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f930d2b5-623c-417a-ab62-281b3371c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:53.671288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 726/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:53.714189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fbfc8-580c-4ded-929f-5f36a205af71 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:53.715702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b1fbfc8-580c-4ded-929f-5f36a205af71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:53.726197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:53.864235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fbfc8-580c-4ded-929f-5f36a205af71 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:53.944681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:53.977433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f9c20-5614-4df6-8d39-1e8ee725db2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:53.978077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f9c20-5614-4df6-8d39-1e8ee725db2d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:53.978360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f9c20-5614-4df6-8d39-1e8ee725db2d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:53.978635 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f9c20-5614-4df6-8d39-1e8ee725db2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:53.980267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-992f9c20-5614-4df6-8d39-1e8ee725db2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:54.068521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f9c20-5614-4df6-8d39-1e8ee725db2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:54.070193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f9c20-5614-4df6-8d39-1e8ee725db2d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:54.089582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 755/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:56.343358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbfa28-c07c-49ef-a025-46b728ad6800 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:56.343905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbfa28-c07c-49ef-a025-46b728ad6800 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:56.343905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbfa28-c07c-49ef-a025-46b728ad6800 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:56.345321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 727/1482] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:56.350984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d9563-75e7-4ab8-9d1a-72172d934714 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:56.351446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d9563-75e7-4ab8-9d1a-72172d934714 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:56.351552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d9563-75e7-4ab8-9d1a-72172d934714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:56.418776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b1d9563-75e7-4ab8-9d1a-72172d934714 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:56.419993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b1d9563-75e7-4ab8-9d1a-72172d934714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:56.465515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:56.517508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 756/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:56.555307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbfa28-c07c-49ef-a025-46b728ad6800 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:56.557268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-59bbfa28-c07c-49ef-a025-46b728ad6800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:56.581562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:56.663030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbfa28-c07c-49ef-a025-46b728ad6800 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:56.736508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e63ed-67d9-490e-a8dd-76135e7a3782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:56.737439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e63ed-67d9-490e-a8dd-76135e7a3782 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:56.737707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e63ed-67d9-490e-a8dd-76135e7a3782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:56.737987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e63ed-67d9-490e-a8dd-76135e7a3782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:56.739633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ae2e63ed-67d9-490e-a8dd-76135e7a3782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:56.811760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:56.855248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e63ed-67d9-490e-a8dd-76135e7a3782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:56.856720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e63ed-67d9-490e-a8dd-76135e7a3782 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:56.875411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 728/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:58.974071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117be23-33b1-4cf6-be83-1a1277f0dc84 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:58.974659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117be23-33b1-4cf6-be83-1a1277f0dc84 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:58.974659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117be23-33b1-4cf6-be83-1a1277f0dc84 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:58.975997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 757/1485] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:58.981181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8895e1-bacb-4386-8c85-0a13c9a2fe6a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:58.981591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8895e1-bacb-4386-8c85-0a13c9a2fe6a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:58.981740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8895e1-bacb-4386-8c85-0a13c9a2fe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:59.046057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fe8895e1-bacb-4386-8c85-0a13c9a2fe6a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:59.047251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fe8895e1-bacb-4386-8c85-0a13c9a2fe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:59.144386 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 729/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:59.183295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117be23-33b1-4cf6-be83-1a1277f0dc84 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:59.184869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4117be23-33b1-4cf6-be83-1a1277f0dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:59.290753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117be23-33b1-4cf6-be83-1a1277f0dc84 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:59.364977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:59.366919 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac17e5b-03b3-4b7b-90af-af38543abafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:59.367770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17e5b-03b3-4b7b-90af-af38543abafc service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:59.368112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17e5b-03b3-4b7b-90af-af38543abafc service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:59.368577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17e5b-03b3-4b7b-90af-af38543abafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:59.370482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ac17e5b-03b3-4b7b-90af-af38543abafc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:59.598694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac17e5b-03b3-4b7b-90af-af38543abafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:59.600141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac17e5b-03b3-4b7b-90af-af38543abafc service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:59.618968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 758/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:13:01.744890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a9f46-5279-43f0-a3c0-e5d733b2bd33 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:13:01.745487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a9f46-5279-43f0-a3c0-e5d733b2bd33 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:13:01.745487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a9f46-5279-43f0-a3c0-e5d733b2bd33 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:13:01.746827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 730/1488] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:13:01.751918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6027-cedf-4663-8f0c-0eb08e06c9b1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:13:01.752337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6027-cedf-4663-8f0c-0eb08e06c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:13:01.752474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6027-cedf-4663-8f0c-0eb08e06c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:13:01.816293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-07eb6027-cedf-4663-8f0c-0eb08e06c9b1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:13:01.817647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-07eb6027-cedf-4663-8f0c-0eb08e06c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:13:01.869676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:13:01.912627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 759/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:13:01.953761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a9f46-5279-43f0-a3c0-e5d733b2bd33 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:13:01.955307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d29a9f46-5279-43f0-a3c0-e5d733b2bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:13:01.991793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:13:02.059387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a9f46-5279-43f0-a3c0-e5d733b2bd33 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:13:02.132979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5f467-801b-47aa-8bd1-e412a7e2e73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:13:02.133560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f467-801b-47aa-8bd1-e412a7e2e73d service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:13:02.133847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f467-801b-47aa-8bd1-e412a7e2e73d service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:13:02.134129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f467-801b-47aa-8bd1-e412a7e2e73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:13:02.135789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-56c5f467-801b-47aa-8bd1-e412a7e2e73d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:13:02.215465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:13:02.246191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f467-801b-47aa-8bd1-e412a7e2e73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:13:02.247655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f467-801b-47aa-8bd1-e412a7e2e73d service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:13:02.266272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 731/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:13:04.531648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a765-69ab-4e2c-b443-5322da3c7e90 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:13:04.532189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a765-69ab-4e2c-b443-5322da3c7e90 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:13:04.532189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a765-69ab-4e2c-b443-5322da3c7e90 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:13:04.533606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 760/1491] 10.222.0.45 () {54 vars in 926 bytes} [Thu Jul 21 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:13:04.539093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdce97-dabe-4738-ae29-a336b2f28b18 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:13:04.539530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdce97-dabe-4738-ae29-a336b2f28b18 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:13:04.539687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdce97-dabe-4738-ae29-a336b2f28b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:13:04.605533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f8cdce97-dabe-4738-ae29-a336b2f28b18 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:13:04.606743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f8cdce97-dabe-4738-ae29-a336b2f28b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:13:04.709619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 732/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Thu Jul 21 04:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:13:04.748866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0a765-69ab-4e2c-b443-5322da3c7e90 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:13:04.750435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2cc0a765-69ab-4e2c-b443-5322da3c7e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:13:04.855594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0a765-69ab-4e2c-b443-5322da3c7e90 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:13:04.929150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3006-87a2-4859-a5f5-154d12f38616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:13:04.929787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3006-87a2-4859-a5f5-154d12f38616 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:13:04.930076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3006-87a2-4859-a5f5-154d12f38616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:13:04.930364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3006-87a2-4859-a5f5-154d12f38616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:13:04.932027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-94ae3006-87a2-4859-a5f5-154d12f38616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:13:04.941191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:13:05.040232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae3006-87a2-4859-a5f5-154d12f38616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:13:05.041636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae3006-87a2-4859-a5f5-154d12f38616 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:13:05.062037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 761/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:13:14.707646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=82 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:13:15.058826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=50 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:31.075818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:31.076414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:31.076414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:31.149553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:31.150771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:31.246984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 733/1494] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:31.256272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed67da-6e2c-47f5-8f4d-7730a385edb3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:31.256755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed67da-6e2c-47f5-8f4d-7730a385edb3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:31.256887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed67da-6e2c-47f5-8f4d-7730a385edb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:31.331368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8bed67da-6e2c-47f5-8f4d-7730a385edb3 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:31.333202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8bed67da-6e2c-47f5-8f4d-7730a385edb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:31.427033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 762/1495] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:31.431700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:31.432979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:31.446311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd60bfa-e5f6-4aa6-9add-a8f66d63ffcb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:31.506574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:31.539669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:31.540325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:31.540608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:31.540919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:31.541634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:14:31.541941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:31.542948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:31.542948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:14:31.542948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:14:31.543830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:31.555318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 734/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:14:31.563176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed67da-6e2c-47f5-8f4d-7730a385edb3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:31.573671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed67da-6e2c-47f5-8f4d-7730a385edb3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:31.634286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:31.668354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:31.669044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:31.669324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:31.669599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:31.670291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:31.672021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:31.672021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jul 21 04:14:31.672021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: Jul 21 04:14:31.673246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:31.727270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 763/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:14:31 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:14:31.731620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:31.733242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:31.766779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158465a1-a0d3-4802-9372-d50f13329b89 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:31.861797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:31.862462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:31.862748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:31.863073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:31.863766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:31.865059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:31.865059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:14:31.865059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:14:31.866281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:31.906241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 735/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:14:31 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:14:31.911035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:31.912551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:31.975113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5e763-b77e-42b0-a79d-4714bb3e4969 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:32.059042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:32.070185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:32.070853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:32.071137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:32.071415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:32.072144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:32.073190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:32.073190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jul 21 04:14:32.073190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: Jul 21 04:14:32.074071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:32.086958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 764/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:14:32.091007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:32.092570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:32.104757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d67b-1a0d-4db5-bc71-d87a5f85f731 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:32.129391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:32.200420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d932bc-3433-4822-bb08-e82c007d8c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:32.201045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d932bc-3433-4822-bb08-e82c007d8c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:32.201334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d932bc-3433-4822-bb08-e82c007d8c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:32.201616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d932bc-3433-4822-bb08-e82c007d8c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:32.202341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d932bc-3433-4822-bb08-e82c007d8c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:32.203360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-15d932bc-3433-4822-bb08-e82c007d8c95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:32.203360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:14:32.203360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:14:32.204247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d932bc-3433-4822-bb08-e82c007d8c95 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:32.216993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 736/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:14:32.221243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:32.223275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:32.256747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930fb2-361a-42d3-96cd-836860fdee49 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:32.349531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469a620-ca0d-4a12-a557-825f62966701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:32.350407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469a620-ca0d-4a12-a557-825f62966701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:32.350685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469a620-ca0d-4a12-a557-825f62966701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:32.350957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469a620-ca0d-4a12-a557-825f62966701 admin admin] PATH_INFO: `/v3/projects/90b0137142954084bc742276bdc2447c/users/e25a67cb2db24a309ae9a3feb6cd505d/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:32.373183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469a620-ca0d-4a12-a557-825f62966701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b0137142954084bc742276bdc2447c, user_id=e25a67cb2db24a309ae9a3feb6cd505d, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:32.374210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-9469a620-ca0d-4a12-a557-825f62966701 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:32.374210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jul 21 04:14:32.374210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: Jul 21 04:14:32.376135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469a620-ca0d-4a12-a557-825f62966701 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:32.399129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 765/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:14:32 2022] PUT /identity/v3/projects/90b0137142954084bc742276bdc2447c/users/e25a67cb2db24a309ae9a3feb6cd505d/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:14:32.411572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc0a4-57cf-4ccf-9dc2-592d58e65fb1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:32.411863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc0a4-57cf-4ccf-9dc2-592d58e65fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:32.412144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc0a4-57cf-4ccf-9dc2-592d58e65fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:32.467499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-642fc0a4-57cf-4ccf-9dc2-592d58e65fb1 None None] MFA Rules not processed for user `e25a67cb2db24a309ae9a3feb6cd505d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:32.468640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-642fc0a4-57cf-4ccf-9dc2-592d58e65fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:32.546709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 737/1502] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:32.560652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7cc2-d00c-4830-a8c0-7403dc084b2a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:32.561049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7cc2-d00c-4830-a8c0-7403dc084b2a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:32.561329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7cc2-d00c-4830-a8c0-7403dc084b2a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:32.562697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 766/1503] 10.222.0.45 () {54 vars in 964 bytes} [Thu Jul 21 04:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:14:32.568364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867979-1bc2-4f09-8aa4-6cd634945b22 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:32.568641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867979-1bc2-4f09-8aa4-6cd634945b22 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:32.568955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867979-1bc2-4f09-8aa4-6cd634945b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:32.598627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:32.644242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d8867979-1bc2-4f09-8aa4-6cd634945b22 None None] MFA Rules not processed for user `473f1bd4a95f4899a4a9a9927f14738c`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:32.645552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8867979-1bc2-4f09-8aa4-6cd634945b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:32.722521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 738/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Jul 21 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:32.730473 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7cc2-d00c-4830-a8c0-7403dc084b2a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:32.732080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-522f7cc2-d00c-4830-a8c0-7403dc084b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:32.783179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:32.838372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7cc2-d00c-4830-a8c0-7403dc084b2a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:32.911852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:32.912491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:32.912789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:32.913078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:32.914709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:33.012151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:33.013624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:33.017250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:33.032148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 767/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:14:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:14:33.075209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef8e85-00f0-462f-9dbe-914971872546 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:33.075501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef8e85-00f0-462f-9dbe-914971872546 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:33.075786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef8e85-00f0-462f-9dbe-914971872546 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:33.077117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 739/1506] 10.222.0.45 () {52 vars in 829 bytes} [Thu Jul 21 04:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:14:33.080623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:33.081874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:33.181481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3191-84b6-405c-9c6c-a0dbe51d18d0 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:33.275410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:33.276207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:33.276493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:33.276772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] PATH_INFO: `/v3/users/e25a67cb2db24a309ae9a3feb6cd505d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:33.289718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25a67cb2db24a309ae9a3feb6cd505d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:33.290747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:33.290747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jul 21 04:14:33.290747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: Jul 21 04:14:33.291963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:33.301670 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:33.354822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25a67cb2db24a309ae9a3feb6cd505d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:33.373235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25a67cb2db24a309ae9a3feb6cd505d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:33.385206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25a67cb2db24a309ae9a3feb6cd505d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:33.398365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25a67cb2db24a309ae9a3feb6cd505d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:33.398911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25a67cb2db24a309ae9a3feb6cd505d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:33.404491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 768/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:14:33 2022] DELETE /identity/v3/users/e25a67cb2db24a309ae9a3feb6cd505d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:14:33.408927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:33.409423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:33.409541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:33.464407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:33.465654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:33.540619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:33.554087 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 740/1508] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:33.563528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:33.564796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:33.665128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa98745-8e0e-4c8d-82c5-834b926383cc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:33.721791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:33.742488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240adda2-282f-472a-a872-573e69961739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:33.743139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adda2-282f-472a-a872-573e69961739 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:33.743422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adda2-282f-472a-a872-573e69961739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:33.743701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adda2-282f-472a-a872-573e69961739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:33.745367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-240adda2-282f-472a-a872-573e69961739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:33.853081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240adda2-282f-472a-a872-573e69961739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:33.854447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240adda2-282f-472a-a872-573e69961739 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:33.872924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 769/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:14:34.371247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:34.372517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:34.384708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54578c8-e1db-447f-8a4e-2da23ff2d370 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:34.483039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:34.483900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:34.484179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:34.484453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] PATH_INFO: `/v3/projects/90b0137142954084bc742276bdc2447c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:34.495144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b0137142954084bc742276bdc2447c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:34.496179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:34.496179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:14:34.496179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:14:34.497412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:34.554687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b0137142954084bc742276bdc2447c', 'request_id': 'req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:34.568091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b0137142954084bc742276bdc2447c', 'request_id': 'req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:34.578187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b0137142954084bc742276bdc2447c', 'request_id': 'req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:34.601042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] The token cache is being invalidate because project 90b0137142954084bc742276bdc2447c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:14:34.601334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:34.601765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03dc5c45-28eb-4bdd-ab1f-7882c340d4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:34.603249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 741/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:14:34 2022] DELETE /identity/v3/projects/90b0137142954084bc742276bdc2447c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:14:43.870625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=62 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:44.599015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:10.133917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4cc57-7b99-4580-9c7d-788980c8c5e8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:10.134538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4cc57-7b99-4580-9c7d-788980c8c5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:10.134538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4cc57-7b99-4580-9c7d-788980c8c5e8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:10.135932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 770/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:10.140979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918bb7-543c-4824-ae12-30af7ddd8541 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:10.141409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918bb7-543c-4824-ae12-30af7ddd8541 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:10.141554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918bb7-543c-4824-ae12-30af7ddd8541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:10.224128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7c918bb7-543c-4824-ae12-30af7ddd8541 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:10.225402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7c918bb7-543c-4824-ae12-30af7ddd8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:10.327159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 742/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:10.481652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4cc57-7b99-4580-9c7d-788980c8c5e8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:10.483786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1aa4cc57-7b99-4580-9c7d-788980c8c5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:10.602345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4cc57-7b99-4580-9c7d-788980c8c5e8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:10.608185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe505-8d7c-45db-a740-25028ac9137c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:10.608476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe505-8d7c-45db-a740-25028ac9137c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:10.608764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe505-8d7c-45db-a740-25028ac9137c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:10.609070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe505-8d7c-45db-a740-25028ac9137c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:10.617708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe505-8d7c-45db-a740-25028ac9137c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:10.619278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe505-8d7c-45db-a740-25028ac9137c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:10.628615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 771/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:11.463722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636172-0edf-432d-8f91-740d832ed335 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:11.464330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636172-0edf-432d-8f91-740d832ed335 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:11.464497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636172-0edf-432d-8f91-740d832ed335 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:11.465975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:11.470925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda26b-b799-4466-a388-53c8b47c1a87 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:11.471334 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda26b-b799-4466-a388-53c8b47c1a87 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:11.471520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda26b-b799-4466-a388-53c8b47c1a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:11.490448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ccda26b-b799-4466-a388-53c8b47c1a87 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:11.491904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ccda26b-b799-4466-a388-53c8b47c1a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:11.499739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:11.655083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636172-0edf-432d-8f91-740d832ed335 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:11.670996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636172-0edf-432d-8f91-740d832ed335 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:11.677072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc132c3-7c97-4565-aff0-904395a7ff57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:11.677717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc132c3-7c97-4565-aff0-904395a7ff57 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:11.678041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc132c3-7c97-4565-aff0-904395a7ff57 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:11.678326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc132c3-7c97-4565-aff0-904395a7ff57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:11.690190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc132c3-7c97-4565-aff0-904395a7ff57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:11.692732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc132c3-7c97-4565-aff0-904395a7ff57 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:11.702288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 744/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:12.367080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4c36c-5667-4974-894b-0a812af9fad5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:12.367444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4c36c-5667-4974-894b-0a812af9fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:12.367786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4c36c-5667-4974-894b-0a812af9fad5 None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:12.369218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 773/1517] 10.222.0.13 () {54 vars in 925 bytes} [Thu Jul 21 04:16:12 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:16:12.375952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa2731-963e-48c7-895a-90e802211bdc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:12.376269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa2731-963e-48c7-895a-90e802211bdc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:12.376550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa2731-963e-48c7-895a-90e802211bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:12.434844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f9aa2731-963e-48c7-895a-90e802211bdc None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:12.436037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f9aa2731-963e-48c7-895a-90e802211bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:12.453273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:12.508357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 745/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jul 21 04:16:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:21.285723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44c23-2341-405a-93ef-5cc0766a7d7d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:21.286845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44c23-2341-405a-93ef-5cc0766a7d7d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:21.286845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44c23-2341-405a-93ef-5cc0766a7d7d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:21.288416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 774/1519] 10.222.0.45 () {54 vars in 961 bytes} [Thu Jul 21 04:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:21.293335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140aa4-9b0a-4d59-9ec7-e2b72bd70d20 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:21.293742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140aa4-9b0a-4d59-9ec7-e2b72bd70d20 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:21.293898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140aa4-9b0a-4d59-9ec7-e2b72bd70d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:21.312560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d9140aa4-9b0a-4d59-9ec7-e2b72bd70d20 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:21.313799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d9140aa4-9b0a-4d59-9ec7-e2b72bd70d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:21.322639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 746/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jul 21 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:21.329904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44c23-2341-405a-93ef-5cc0766a7d7d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:21.343411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44c23-2341-405a-93ef-5cc0766a7d7d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:21.348274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b682e-880f-439b-a97d-9eea1abd50c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:21.349740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b682e-880f-439b-a97d-9eea1abd50c4 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:21.350043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b682e-880f-439b-a97d-9eea1abd50c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:21.350320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b682e-880f-439b-a97d-9eea1abd50c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:21.358407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b682e-880f-439b-a97d-9eea1abd50c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:21.359961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b682e-880f-439b-a97d-9eea1abd50c4 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:21.370631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 775/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:22.922458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776a4c-aeb9-4996-8bb6-0735439fe124 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:22.922994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776a4c-aeb9-4996-8bb6-0735439fe124 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:22.922994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776a4c-aeb9-4996-8bb6-0735439fe124 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:22.924282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:22.930083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e4dd5-1f1e-4ff4-a263-36324a99bc7b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:22.930555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e4dd5-1f1e-4ff4-a263-36324a99bc7b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:22.930657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e4dd5-1f1e-4ff4-a263-36324a99bc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:22.948569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd8e4dd5-1f1e-4ff4-a263-36324a99bc7b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:22.949823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd8e4dd5-1f1e-4ff4-a263-36324a99bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:22.957623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:23.117742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776a4c-aeb9-4996-8bb6-0735439fe124 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:23.132346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776a4c-aeb9-4996-8bb6-0735439fe124 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:23.137893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b91b7-f0fa-4dd2-a462-9c5e2434fa13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:23.138527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b91b7-f0fa-4dd2-a462-9c5e2434fa13 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:23.138816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b91b7-f0fa-4dd2-a462-9c5e2434fa13 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:23.139098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b91b7-f0fa-4dd2-a462-9c5e2434fa13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:23.147773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b91b7-f0fa-4dd2-a462-9c5e2434fa13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:23.149419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b91b7-f0fa-4dd2-a462-9c5e2434fa13 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:23.158896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 748/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:23.986123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b130f6-8e23-491b-9906-aab18ba55f24 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:23.986639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b130f6-8e23-491b-9906-aab18ba55f24 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:23.986639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b130f6-8e23-491b-9906-aab18ba55f24 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:23.987977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 777/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:23.993902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db8bd-65cd-4343-b9de-a2c0c67f954d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:23.994336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db8bd-65cd-4343-b9de-a2c0c67f954d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:23.994485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db8bd-65cd-4343-b9de-a2c0c67f954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:24.012675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bc4db8bd-65cd-4343-b9de-a2c0c67f954d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:24.013885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bc4db8bd-65cd-4343-b9de-a2c0c67f954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:24.021788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 749/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:24.173354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b130f6-8e23-491b-9906-aab18ba55f24 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:24.188390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b130f6-8e23-491b-9906-aab18ba55f24 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:24.194610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109fa9-d7ae-4ba1-b269-9ff7ef5901cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:24.195250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109fa9-d7ae-4ba1-b269-9ff7ef5901cc service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:24.195536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109fa9-d7ae-4ba1-b269-9ff7ef5901cc service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:24.195815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109fa9-d7ae-4ba1-b269-9ff7ef5901cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:24.204180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109fa9-d7ae-4ba1-b269-9ff7ef5901cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:24.205782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109fa9-d7ae-4ba1-b269-9ff7ef5901cc service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:24.215361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 778/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:28.054858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb07f8-a998-4230-b493-0ee2bbc2405c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:28.055400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb07f8-a998-4230-b493-0ee2bbc2405c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:28.055400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb07f8-a998-4230-b493-0ee2bbc2405c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:28.056781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:28.062246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0d88-4010-47af-80c2-aab514b66b27 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:28.062684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0d88-4010-47af-80c2-aab514b66b27 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:28.062808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0d88-4010-47af-80c2-aab514b66b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:28.080442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-807f0d88-4010-47af-80c2-aab514b66b27 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:28.081680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-807f0d88-4010-47af-80c2-aab514b66b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:28.089539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:28.163926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb07f8-a998-4230-b493-0ee2bbc2405c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:28.165671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4deb07f8-a998-4230-b493-0ee2bbc2405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:28.243070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb07f8-a998-4230-b493-0ee2bbc2405c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:28.246645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49689f35-4288-4101-85b5-f03032a663f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:28.247278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689f35-4288-4101-85b5-f03032a663f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:28.247566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689f35-4288-4101-85b5-f03032a663f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:28.247845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689f35-4288-4101-85b5-f03032a663f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:28.257636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49689f35-4288-4101-85b5-f03032a663f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:28.259074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49689f35-4288-4101-85b5-f03032a663f3 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:28.268321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 751/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:30.308599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f87658-a436-4242-b48c-0583a3a7727c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:30.309181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f87658-a436-4242-b48c-0583a3a7727c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:30.309181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f87658-a436-4242-b48c-0583a3a7727c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:30.310613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:30.315664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cef74-34a1-440e-8be5-b99d9758ef3f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:30.316073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cef74-34a1-440e-8be5-b99d9758ef3f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:30.316226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cef74-34a1-440e-8be5-b99d9758ef3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:30.334723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-762cef74-34a1-440e-8be5-b99d9758ef3f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:30.335921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-762cef74-34a1-440e-8be5-b99d9758ef3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:30.343948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:30.381068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f87658-a436-4242-b48c-0583a3a7727c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:30.391598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f87658-a436-4242-b48c-0583a3a7727c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:30.395026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9eb46-4968-4556-8ab9-43110b306370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:30.395798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9eb46-4968-4556-8ab9-43110b306370 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:30.396084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9eb46-4968-4556-8ab9-43110b306370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:30.396363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9eb46-4968-4556-8ab9-43110b306370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:30.405841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9eb46-4968-4556-8ab9-43110b306370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:30.407260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9eb46-4968-4556-8ab9-43110b306370 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:30.417378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 781/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:33.899902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ef81-5396-4ee7-9c5a-21d0ebbe9d6b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:33.900501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ef81-5396-4ee7-9c5a-21d0ebbe9d6b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:33.900501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ef81-5396-4ee7-9c5a-21d0ebbe9d6b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:33.901890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:33.906971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e048ee-a068-43aa-85d1-3eb165edd998 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:33.907427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e048ee-a068-43aa-85d1-3eb165edd998 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:33.907565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e048ee-a068-43aa-85d1-3eb165edd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:33.914024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:33.927169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a6e048ee-a068-43aa-85d1-3eb165edd998 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:33.928308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a6e048ee-a068-43aa-85d1-3eb165edd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:33.936361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:34.242435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696ef81-5396-4ee7-9c5a-21d0ebbe9d6b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:34.244121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8696ef81-5396-4ee7-9c5a-21d0ebbe9d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:34.310111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:34.324143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696ef81-5396-4ee7-9c5a-21d0ebbe9d6b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:34.327775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577ce5d-6699-49d4-bd4d-56d0dac98af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:34.328413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ce5d-6699-49d4-bd4d-56d0dac98af1 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:34.328695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ce5d-6699-49d4-bd4d-56d0dac98af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:34.329004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ce5d-6699-49d4-bd4d-56d0dac98af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:34.338562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577ce5d-6699-49d4-bd4d-56d0dac98af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:34.339999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577ce5d-6699-49d4-bd4d-56d0dac98af1 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:34.349753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 754/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:36.429234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f72f-5039-435b-bb51-d6406c2da538 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:36.429831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f72f-5039-435b-bb51-d6406c2da538 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:36.429831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f72f-5039-435b-bb51-d6406c2da538 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:36.431164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:36.436358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc7ad-aeaa-40cf-b735-1d0ff956913d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:36.436786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc7ad-aeaa-40cf-b735-1d0ff956913d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:36.436953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc7ad-aeaa-40cf-b735-1d0ff956913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:36.454890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-16ebc7ad-aeaa-40cf-b735-1d0ff956913d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:36.456088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-16ebc7ad-aeaa-40cf-b735-1d0ff956913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:36.464028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:36.773692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f72f-5039-435b-bb51-d6406c2da538 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:36.775357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e009f72f-5039-435b-bb51-d6406c2da538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:36.789130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f72f-5039-435b-bb51-d6406c2da538 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:36.792531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df9618-33c9-45c3-b20e-41780673172e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:36.793199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df9618-33c9-45c3-b20e-41780673172e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:36.793483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df9618-33c9-45c3-b20e-41780673172e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:36.793758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df9618-33c9-45c3-b20e-41780673172e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:36.803111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df9618-33c9-45c3-b20e-41780673172e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:36.804553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df9618-33c9-45c3-b20e-41780673172e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:36.814109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 784/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:46.449983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=11 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:46.809918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:04.267388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3bd7f-4749-4918-9cc1-6dd43b397287 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.269960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3bd7f-4749-4918-9cc1-6dd43b397287 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.269960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3bd7f-4749-4918-9cc1-6dd43b397287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.293462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b7a3bd7f-4749-4918-9cc1-6dd43b397287 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.294686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b7a3bd7f-4749-4918-9cc1-6dd43b397287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.309573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 756/1540] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.318890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6473c-0932-4fd9-bfc4-e88529167eda None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.320385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6473c-0932-4fd9-bfc4-e88529167eda None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.320385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6473c-0932-4fd9-bfc4-e88529167eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.347189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bea6473c-0932-4fd9-bfc4-e88529167eda None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.348472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bea6473c-0932-4fd9-bfc4-e88529167eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.362288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 785/1541] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.367529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3bd7f-4749-4918-9cc1-6dd43b397287 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.378942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3bd7f-4749-4918-9cc1-6dd43b397287 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.394866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b353-875d-459f-8adb-b61ca8d339bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.395563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b353-875d-459f-8adb-b61ca8d339bb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.395899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b353-875d-459f-8adb-b61ca8d339bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.396641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b353-875d-459f-8adb-b61ca8d339bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.397323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b353-875d-459f-8adb-b61ca8d339bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:04.397643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b353-875d-459f-8adb-b61ca8d339bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.399287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b353-875d-459f-8adb-b61ca8d339bb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:04.419692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 757/1542] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:04.428373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6473c-0932-4fd9-bfc4-e88529167eda None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.443483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6473c-0932-4fd9-bfc4-e88529167eda None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.451542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.452222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.452511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.452792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.453747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.455675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:04.487004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147c8b-7bb2-4950-84d6-17efa4d73c4e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.487362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147c8b-7bb2-4950-84d6-17efa4d73c4e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.487589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147c8b-7bb2-4950-84d6-17efa4d73c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.514652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 786/1543] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:04.523693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.526827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-81147c8b-7bb2-4950-84d6-17efa4d73c4e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.528066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-81147c8b-7bb2-4950-84d6-17efa4d73c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.620406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ebfc-000e-4650-ab50-90cb7d733b31 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.636542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ef54-13ea-4ffc-b9b3-c4811f166e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.637256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ef54-13ea-4ffc-b9b3-c4811f166e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.637547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ef54-13ea-4ffc-b9b3-c4811f166e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.637827 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ef54-13ea-4ffc-b9b3-c4811f166e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.638542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ef54-13ea-4ffc-b9b3-c4811f166e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.639567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-8f99ef54-13ea-4ffc-b9b3-c4811f166e6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:04.639567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jul 21 04:18:04.639567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: Jul 21 04:18:04.640781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ef54-13ea-4ffc-b9b3-c4811f166e6f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:04.656925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 758/1544] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 21 04:18:04.656925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1df89-63d6-4d00-8218-8958eccf7ef5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.656925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1df89-63d6-4d00-8218-8958eccf7ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.656925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1df89-63d6-4d00-8218-8958eccf7ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.705335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 787/1545] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:04.706956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee3d5-c0e6-4779-b3b7-d8a90d8f0588 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.707249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee3d5-c0e6-4779-b3b7-d8a90d8f0588 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.707518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee3d5-c0e6-4779-b3b7-d8a90d8f0588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.712045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c3b1df89-63d6-4d00-8218-8958eccf7ef5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.713898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c3b1df89-63d6-4d00-8218-8958eccf7ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.723631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 759/1546] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.730238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97fc1-a8ea-4d8a-b50b-89b100840640 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.730536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97fc1-a8ea-4d8a-b50b-89b100840640 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.730836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97fc1-a8ea-4d8a-b50b-89b100840640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.737534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dddee3d5-c0e6-4779-b3b7-d8a90d8f0588 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.738740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dddee3d5-c0e6-4779-b3b7-d8a90d8f0588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.747933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 788/1547] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.752979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58e54e-7b2c-474e-94dd-da762dccdf97 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.752979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58e54e-7b2c-474e-94dd-da762dccdf97 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.752979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58e54e-7b2c-474e-94dd-da762dccdf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.753893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7ee97fc1-a8ea-4d8a-b50b-89b100840640 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.755169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7ee97fc1-a8ea-4d8a-b50b-89b100840640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.763688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 760/1548] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.768372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4078cf-efa7-47f3-ac0a-4ad129e85e3c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.768641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4078cf-efa7-47f3-ac0a-4ad129e85e3c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.768951 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4078cf-efa7-47f3-ac0a-4ad129e85e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.772276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0d58e54e-7b2c-474e-94dd-da762dccdf97 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.773521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0d58e54e-7b2c-474e-94dd-da762dccdf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.781965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 789/1549] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.782716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58e54e-7b2c-474e-94dd-da762dccdf97 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.793237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58e54e-7b2c-474e-94dd-da762dccdf97 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.796585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ae4078cf-efa7-47f3-ac0a-4ad129e85e3c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.798041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4871a-f756-4083-934b-56e3b267cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.798209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ae4078cf-efa7-47f3-ac0a-4ad129e85e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.798674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4871a-f756-4083-934b-56e3b267cf0b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.798962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4871a-f756-4083-934b-56e3b267cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.799275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4871a-f756-4083-934b-56e3b267cf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.799968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4871a-f756-4083-934b-56e3b267cf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.802965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4871a-f756-4083-934b-56e3b267cf0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:04.809456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 761/1550] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.811011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a28c-d424-42d9-8471-6377a6c59b17 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.811428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a28c-d424-42d9-8471-6377a6c59b17 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.811766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0a28c-d424-42d9-8471-6377a6c59b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.814257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 790/1551] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:04.815689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c19e3-4091-4901-ba1d-96f6abd54c7e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.816000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c19e3-4091-4901-ba1d-96f6abd54c7e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.816291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c19e3-4091-4901-ba1d-96f6abd54c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.833674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8dc0a28c-d424-42d9-8471-6377a6c59b17 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.834879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8dc0a28c-d424-42d9-8471-6377a6c59b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.835416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-328c19e3-4091-4901-ba1d-96f6abd54c7e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.836605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-328c19e3-4091-4901-ba1d-96f6abd54c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.842949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 762/1552] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.845073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e711b4-0334-4b30-9f07-af37fea29131 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.845073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e711b4-0334-4b30-9f07-af37fea29131 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.845073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e711b4-0334-4b30-9f07-af37fea29131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.846351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 791/1553] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.847218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c19e3-4091-4901-ba1d-96f6abd54c7e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.858044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c19e3-4091-4901-ba1d-96f6abd54c7e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.862711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.863372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.863657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.863937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.865485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:04.865801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.867071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:04.867071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jul 21 04:18:04.867071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: Jul 21 04:18:04.867987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77d600-77d0-4f20-90ea-ca66a550f4ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:04.868106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-26e711b4-0334-4b30-9f07-af37fea29131 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.869471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-26e711b4-0334-4b30-9f07-af37fea29131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.878061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 763/1554] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.881881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954344c6-81a3-48c7-a6fe-f2cb3805771f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.881881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954344c6-81a3-48c7-a6fe-f2cb3805771f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.881881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954344c6-81a3-48c7-a6fe-f2cb3805771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.882172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 792/1555] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:04.882277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc62a00-321e-4913-8b00-85df6cd6ea1e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.882540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc62a00-321e-4913-8b00-85df6cd6ea1e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.882822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc62a00-321e-4913-8b00-85df6cd6ea1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.903226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7bc62a00-321e-4913-8b00-85df6cd6ea1e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.903524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-954344c6-81a3-48c7-a6fe-f2cb3805771f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.904443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7bc62a00-321e-4913-8b00-85df6cd6ea1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.904739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-954344c6-81a3-48c7-a6fe-f2cb3805771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.912853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 793/1556] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.920349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 764/1557] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.920488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbe392-13cf-4f46-ba94-71bd7fe70883 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.920594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954344c6-81a3-48c7-a6fe-f2cb3805771f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.920682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbe392-13cf-4f46-ba94-71bd7fe70883 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.920682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbe392-13cf-4f46-ba94-71bd7fe70883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.926302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954344c6-81a3-48c7-a6fe-f2cb3805771f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.931506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.932172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.932461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.932745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.933514 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.935138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:04.937770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8edbe392-13cf-4f46-ba94-71bd7fe70883 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.938957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8edbe392-13cf-4f46-ba94-71bd7fe70883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.945360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 765/1558] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:04.946153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.951267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 794/1559] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.951267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda381-b0ac-45c6-95ec-989fc5e4b2cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.951267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda381-b0ac-45c6-95ec-989fc5e4b2cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.951267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda381-b0ac-45c6-95ec-989fc5e4b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.955893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67da9d-68da-46c4-8668-d96217c09bc0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.961876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.962515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.962806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.963093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.963819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:04.964134 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.965767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:04.969595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-52cda381-b0ac-45c6-95ec-989fc5e4b2cd None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:04.970795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52cda381-b0ac-45c6-95ec-989fc5e4b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:04.979362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 795/1560] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:04.980261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cda381-b0ac-45c6-95ec-989fc5e4b2cd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.986587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 766/1561] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:04.987337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:04.990924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cda381-b0ac-45c6-95ec-989fc5e4b2cd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.995874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:04.996541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:04.996812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:04.997127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:04.997854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:04.997972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543b883-eb07-4a7c-8802-5161f847c951 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:04.998165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:04.999758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.002514 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26611e52-4951-4952-b924-be7bd716bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.003157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611e52-4951-4952-b924-be7bd716bcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.003439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611e52-4951-4952-b924-be7bd716bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.003722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611e52-4951-4952-b924-be7bd716bcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.004410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26611e52-4951-4952-b924-be7bd716bcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.005527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-26611e52-4951-4952-b924-be7bd716bcc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:05.005527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:18:05.005527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:18:05.006880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26611e52-4951-4952-b924-be7bd716bcc2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.011776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 796/1562] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:05.012572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.028700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00704bcc-bad7-4d8d-ac1d-03f794fe54c8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.033656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.034253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.034539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.034825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.035563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:05.035878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.037640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 767/1563] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:04 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.037777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.039031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399bce5-dc78-4661-b441-6685256c6c3b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.039323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399bce5-dc78-4661-b441-6685256c6c3b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.039609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399bce5-dc78-4661-b441-6685256c6c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.057764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 797/1564] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:05.057764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.058826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2399bce5-dc78-4661-b441-6685256c6c3b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:05.060027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2399bce5-dc78-4661-b441-6685256c6c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:05.062870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50058a7-a626-4639-b9a4-889f7c997fa8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.081749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:05.108773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:05.120911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.121805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.122288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 768/1565] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:05.122418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.122418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] PATH_INFO: `/v3/projects/6a1bcc85aab44cfbb5c491c40ecf1c2f/users/a18b123f65cc40aa810227421a43bc22/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.123008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399bce5-dc78-4661-b441-6685256c6c3b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.136975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399bce5-dc78-4661-b441-6685256c6c3b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.138100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1bcc85aab44cfbb5c491c40ecf1c2f, user_id=a18b123f65cc40aa810227421a43bc22, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.140692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.141922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.142656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.143119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.143481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.144380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:05.144720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.147161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.153906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 798/1566] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:05 2022] PUT /identity/v3/projects/6a1bcc85aab44cfbb5c491c40ecf1c2f/users/a18b123f65cc40aa810227421a43bc22/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:05.154869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.167350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 769/1567] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:05.168154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.184955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade53d14-47dd-402b-881b-d90277f5b4df admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.220333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7d95-bb35-4dd0-87a4-4e61d6c2b3a2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.225286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.225948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.226233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.226511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.227235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:05.227542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.229201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.241455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 799/1568] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:05.242322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.245531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.246320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.246713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.247339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.248581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.250261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.251828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c6cd6-d949-4935-9292-a171bace3bc7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.257295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.257940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.258228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.258633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.259330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.261275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.278801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 770/1569] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.279814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.291181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 800/1570] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.291181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.346597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e35e6-01b0-41f7-afe8-806ee9a72160 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.352110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.352567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460b97-d6fd-4698-b275-19321fc26ffc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.353076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.353076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.353353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.354040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.356052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.357554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc870d1e-acd9-4f91-a8c7-736836b49395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.358205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870d1e-acd9-4f91-a8c7-736836b49395 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.358488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870d1e-acd9-4f91-a8c7-736836b49395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.358767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870d1e-acd9-4f91-a8c7-736836b49395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.359444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc870d1e-acd9-4f91-a8c7-736836b49395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.361379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc870d1e-acd9-4f91-a8c7-736836b49395 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.376477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 771/1571] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.377600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.389942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008fedb-b601-41c5-8c3a-15fe30428885 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.394703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 801/1572] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.394703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e92bfa-d099-427e-a7c3-311b78fc33f2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.394703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e92bfa-d099-427e-a7c3-311b78fc33f2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.394703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e92bfa-d099-427e-a7c3-311b78fc33f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.400951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:05.424728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f5e92bfa-d099-427e-a7c3-311b78fc33f2 None None] MFA Rules not processed for user `a18b123f65cc40aa810227421a43bc22`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:05.426007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5e92bfa-d099-427e-a7c3-311b78fc33f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:05.444154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:05.451455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.452315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.452608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.452937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.453671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:05.453986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.455644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.467204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 772/1573] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:05.469692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.480535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864dae4-a250-4e68-96a9-6a152c49c3c0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.485375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.486028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.486314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.486596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.487284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.489357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.493025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 802/1574] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:05.493685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e92bfa-d099-427e-a7c3-311b78fc33f2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.503854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e92bfa-d099-427e-a7c3-311b78fc33f2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.509650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.510383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.510754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.511052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.511770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.513943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.519568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 773/1575] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.524007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.542342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 803/1576] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.543071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.584131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73af5-c393-463c-b4b0-dfcc8c8dcff4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.605572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a44f-d4ae-4d9b-9c44-11452ab125b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.610240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.610908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.611198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.611482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.612172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.614199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.634865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 804/1577] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.635900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.643334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.644010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.644298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.644578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.645301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41766-c9f2-4aae-8846-0b3913777ccf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.645561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.648105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.650585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.652864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.652864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.652864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.652864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.655386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.668863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 805/1578] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:05.668863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.672741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 774/1579] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.673583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.677037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862710-d6d5-4b59-8fcd-d4798439e50c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.681810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.682545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.682834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.683120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.683807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.684844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6de9b-d0f1-48d8-9f75-deca15aa0c65 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.685763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.689422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.690058 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.690344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.690623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.691295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.693862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.707340 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 806/1580] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.709126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.719217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78d54-ee7f-435c-9603-78c377ad5992 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.723839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.724672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 775/1581] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.724793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.724923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.725167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.725268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.725854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.727803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.756870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 807/1582] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.756870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.765733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:05.774015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:05.791569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8090f1-f7e9-4eee-9423-cbed198b6fd0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.821256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411776f-aaea-4a50-91e2-7839c5f048f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.826049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.826735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.827026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.827312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.828132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.830201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.849379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.850061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.850211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 808/1583] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.850352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.850640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.850901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.851332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.853499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.860502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39bab-c5c1-41cb-97b4-acd2405e1b7b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.865987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.866926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.867218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.867502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.868267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.869835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.874809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 776/1584] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.877805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.881334 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 809/1585] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:05.881957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.888683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501f2a-d3b6-4e92-bf33-f68978b749c9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.891580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b700-d36e-48fc-95b6-5908f5b26c42 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.893579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.894329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.894748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.895123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.895982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.896243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.896907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.897197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.897480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.898080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.898192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.899776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.909588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 777/1586] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:05.910389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.913543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 810/1587] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:05.914501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.921353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c212-77b6-40d0-b9c7-534439ab174e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.925542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4c39-eef1-42d2-ad5a-f774e955ec28 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.926270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.927454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.927733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.928153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.928915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.930516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.930780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.931431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.931723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.932009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.932856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.934629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.941905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 778/1588] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:05.943477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.954404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25db49-0e4a-4502-ae16-84e618f8aade admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.959101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.959263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 811/1589] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 301 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.962469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.962469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.962661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.962754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.962754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.962945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.969559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846ddde-ba92-46d8-9f82-16b0a5d1045d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.974396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.975042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.975319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:05.975626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:05.976330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:05.977966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:05.982820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 779/1590] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:05 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:05.983623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.992157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 812/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:05.992859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:05.993814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf884ad-7229-4901-a3b2-a7a0407e767c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:05.998834 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:05.999484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:05.999779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.000063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.000785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.002705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.004199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c081f1-6224-4719-8397-023f2fed6a97 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.009775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.010458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.010747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.011029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.011781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.013417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.013571 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 780/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.014349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.024766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c2940-1292-463b-ba91-e72fb67098be admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.025536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 813/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.026448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.030113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.030998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.031280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.031559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] PATH_INFO: `/v3/projects/84da3e824b8c4d018ea577eb2a39213f/users/7b1d74995a6b407698b38e4b74e53556/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.041504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061977-8659-42d5-9846-f4f548d7182f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.046263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.046924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.047209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.047311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=84da3e824b8c4d018ea577eb2a39213f, user_id=7b1d74995a6b407698b38e4b74e53556, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.047491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.048223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.048671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:06.048671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:18:06.048671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:18:06.049837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.050913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.060731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 814/1594] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.060731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.066242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 781/1595] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/84da3e824b8c4d018ea577eb2a39213f/users/7b1d74995a6b407698b38e4b74e53556/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.070592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.074113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a64a1-5189-4b52-8ea8-1d5c0b68ba9b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.132473 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.132801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc6e66-97aa-42e6-ba05-cf220493b7fd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.133166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.133460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.133741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.134603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.136347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.137801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.138470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.138762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.139046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.139772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.141415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.147229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 815/1596] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.147229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.155189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 782/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.155189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.158186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:06.160534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5e34e-b544-4454-bdb3-de0ec2c44ce6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.164493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4465-b871-479d-baeb-45199cf545fb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.165558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.166237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.166525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.166809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.167561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.169197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.169999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.170826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.171117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.171766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.172497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.174130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.179580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 816/1598] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.180456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.187954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 783/1599] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.188781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.190516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd90ba-4d20-44c0-9dc1-69222719e278 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.196009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.196669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.197001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.197272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.197989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.199266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1761ad2-a54b-45f0-afae-7f8b46b6d08f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.199704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.203912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc3ca-79b6-4e9a-a63e-cfd80c5f5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.204787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc3ca-79b6-4e9a-a63e-cfd80c5f5ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.205104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc3ca-79b6-4e9a-a63e-cfd80c5f5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.205388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc3ca-79b6-4e9a-a63e-cfd80c5f5ef9 admin admin] PATH_INFO: `/v3/projects/1191f6bdd1c946679cc12bbce85ad868/users/50d222dc33d04421a9cdb1672aaacbc9/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.205853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:06.215282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 817/1600] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.215282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.221668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc3ca-79b6-4e9a-a63e-cfd80c5f5ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1191f6bdd1c946679cc12bbce85ad868, user_id=50d222dc33d04421a9cdb1672aaacbc9, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.223527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368f683-08c3-4941-bfb4-06de93afc6f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.224346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc3ca-79b6-4e9a-a63e-cfd80c5f5ef9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.228519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.229451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.229730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.230013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] PATH_INFO: `/v3/projects/909760d49d5b4a1ba59f088f139d4799/users/1e4883f7b657491189ac4012d1bee604/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.237406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 784/1601] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/1191f6bdd1c946679cc12bbce85ad868/users/50d222dc33d04421a9cdb1672aaacbc9/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.238702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adcdfb-70a1-4837-92b1-63a77e56c980 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.239047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adcdfb-70a1-4837-92b1-63a77e56c980 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.239583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adcdfb-70a1-4837-92b1-63a77e56c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.246013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909760d49d5b4a1ba59f088f139d4799, user_id=1e4883f7b657491189ac4012d1bee604, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.248712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.258194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a2adcdfb-70a1-4837-92b1-63a77e56c980 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.259418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a2adcdfb-70a1-4837-92b1-63a77e56c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.262562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 818/1602] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/909760d49d5b4a1ba59f088f139d4799/users/1e4883f7b657491189ac4012d1bee604/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.263478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.319190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 785/1603] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.320045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adcdfb-70a1-4837-92b1-63a77e56c980 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.328574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6541aaf-a6c0-402a-ba75-796a5cd7e1d6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.329706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adcdfb-70a1-4837-92b1-63a77e56c980 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.334044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.334947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.335232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.335361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.335513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] PATH_INFO: `/v3/projects/8d2c5e6dc4014fefb4b386a628a8e3fe/users/8d080955549c4c48a0ba6a573e88abe5/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.335935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.336220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.336500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.337264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.339619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.349568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 786/1604] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.350361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.353384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2c5e6dc4014fefb4b386a628a8e3fe, user_id=8d080955549c4c48a0ba6a573e88abe5, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.356174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.359771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505a52b-60ee-450b-abdb-cb2893ccc9d2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.365397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.366277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.366861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.367110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] PATH_INFO: `/v3/projects/956cc41e111a41ee86a249b21aa02c53/users/84c155dac7d44fbdb0c019f595598655/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.369775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 819/1605] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/8d2c5e6dc4014fefb4b386a628a8e3fe/users/8d080955549c4c48a0ba6a573e88abe5/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.370541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.389810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] RBAC: Authorizing `identity:create_grant(project_id=956cc41e111a41ee86a249b21aa02c53, user_id=84c155dac7d44fbdb0c019f595598655, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.392494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.410045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 787/1606] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/956cc41e111a41ee86a249b21aa02c53/users/84c155dac7d44fbdb0c019f595598655/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.410045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.441086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445b25b-d1ee-4184-8fcb-b841014d648d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.473465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd887c30-562a-4555-9589-8f457d95942d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.478602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b3ab7-08ba-400d-8ffd-1c15080fc6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.479489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b3ab7-08ba-400d-8ffd-1c15080fc6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.479773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b3ab7-08ba-400d-8ffd-1c15080fc6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.480081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b3ab7-08ba-400d-8ffd-1c15080fc6dd admin admin] PATH_INFO: `/v3/projects/cdaecfe27e7643848f2092bce528da22/users/88167593943743f5a2f06548d79f55c0/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.495345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b3ab7-08ba-400d-8ffd-1c15080fc6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdaecfe27e7643848f2092bce528da22, user_id=88167593943743f5a2f06548d79f55c0, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.498062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b3ab7-08ba-400d-8ffd-1c15080fc6dd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.498974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b1505-04ef-4fc3-96d8-70e2220729f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.499864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b1505-04ef-4fc3-96d8-70e2220729f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.500186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b1505-04ef-4fc3-96d8-70e2220729f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.500464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b1505-04ef-4fc3-96d8-70e2220729f2 admin admin] PATH_INFO: `/v3/projects/32079086b59a4260b4e72556b8be29c2/users/a0b60457ec54498f89d72e69ad580fec/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.512482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:06.512917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 788/1607] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/cdaecfe27e7643848f2092bce528da22/users/88167593943743f5a2f06548d79f55c0/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.514659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d9d7-3d3c-454b-8bd5-79faa277273b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.514912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d9d7-3d3c-454b-8bd5-79faa277273b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.515285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d9d7-3d3c-454b-8bd5-79faa277273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.518386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b1505-04ef-4fc3-96d8-70e2220729f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32079086b59a4260b4e72556b8be29c2, user_id=a0b60457ec54498f89d72e69ad580fec, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.522329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b1505-04ef-4fc3-96d8-70e2220729f2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.535355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 820/1608] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/32079086b59a4260b4e72556b8be29c2/users/a0b60457ec54498f89d72e69ad580fec/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.536414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-34c5d9d7-3d3c-454b-8bd5-79faa277273b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.536676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43bd2-4243-4633-9cb5-e41142a60cd9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.536990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43bd2-4243-4633-9cb5-e41142a60cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.537276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43bd2-4243-4633-9cb5-e41142a60cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.537758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-34c5d9d7-3d3c-454b-8bd5-79faa277273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.547756 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:06.555771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0be43bd2-4243-4633-9cb5-e41142a60cd9 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.557037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0be43bd2-4243-4633-9cb5-e41142a60cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.606737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 789/1609] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.607555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5d9d7-3d3c-454b-8bd5-79faa277273b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.619350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 821/1610] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.620176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be43bd2-4243-4633-9cb5-e41142a60cd9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.629911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be43bd2-4243-4633-9cb5-e41142a60cd9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.635278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abffaf-9aa6-4392-be88-63d201de8c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.636173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abffaf-9aa6-4392-be88-63d201de8c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.636465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abffaf-9aa6-4392-be88-63d201de8c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.636749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abffaf-9aa6-4392-be88-63d201de8c6e admin admin] PATH_INFO: `/v3/projects/13d7dcf31b8a4cabba8942339102a83f/users/622daf1b9b2d4ebea6674b18ba15cbb9/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.651601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abffaf-9aa6-4392-be88-63d201de8c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d7dcf31b8a4cabba8942339102a83f, user_id=622daf1b9b2d4ebea6674b18ba15cbb9, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.654418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abffaf-9aa6-4392-be88-63d201de8c6e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.673803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 822/1611] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/13d7dcf31b8a4cabba8942339102a83f/users/622daf1b9b2d4ebea6674b18ba15cbb9/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:06.673803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede872b-cef0-467e-9e48-70292756eedb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.673803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede872b-cef0-467e-9e48-70292756eedb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.673803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede872b-cef0-467e-9e48-70292756eedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.675999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5d9d7-3d3c-454b-8bd5-79faa277273b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.701949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2ede872b-cef0-467e-9e48-70292756eedb None None] MFA Rules not processed for user `8d080955549c4c48a0ba6a573e88abe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.703182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ede872b-cef0-467e-9e48-70292756eedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.730332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7c631-cb80-4f77-9885-92428e85634f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.730989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c631-cb80-4f77-9885-92428e85634f service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.731274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c631-cb80-4f77-9885-92428e85634f service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.731554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c631-cb80-4f77-9885-92428e85634f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.768702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 823/1612] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.769657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede872b-cef0-467e-9e48-70292756eedb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.805624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7c631-cb80-4f77-9885-92428e85634f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.807314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7c631-cb80-4f77-9885-92428e85634f service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.820080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 790/1613] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:06.821647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d15a0-70d9-498a-bc30-e7bf8174cda5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.821940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d15a0-70d9-498a-bc30-e7bf8174cda5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.822227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d15a0-70d9-498a-bc30-e7bf8174cda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.835702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:06.843077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede872b-cef0-467e-9e48-70292756eedb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.850277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7a9f5-f6de-4e7b-9973-f1b799538846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.851357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7a9f5-f6de-4e7b-9973-f1b799538846 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.851716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7a9f5-f6de-4e7b-9973-f1b799538846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.852076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7a9f5-f6de-4e7b-9973-f1b799538846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.852859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cb0d15a0-70d9-498a-bc30-e7bf8174cda5 None None] MFA Rules not processed for user `88167593943743f5a2f06548d79f55c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.853635 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7a9f5-f6de-4e7b-9973-f1b799538846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.854262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cb0d15a0-70d9-498a-bc30-e7bf8174cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.855455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7a9f5-f6de-4e7b-9973-f1b799538846 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.865812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:06.867715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 824/1614] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:06.869049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d152-7b13-4588-87dc-f529cef37d05 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.869355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d152-7b13-4588-87dc-f529cef37d05 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.870223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d152-7b13-4588-87dc-f529cef37d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.890694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-96e2d152-7b13-4588-87dc-f529cef37d05 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.892301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96e2d152-7b13-4588-87dc-f529cef37d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.900871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 825/1615] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.904540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d152-7b13-4588-87dc-f529cef37d05 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.914352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d152-7b13-4588-87dc-f529cef37d05 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.919026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d46f2-21df-438a-9f6a-9a7ee4453b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.919681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d46f2-21df-438a-9f6a-9a7ee4453b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.919967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d46f2-21df-438a-9f6a-9a7ee4453b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.920246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d46f2-21df-438a-9f6a-9a7ee4453b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.933530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d46f2-21df-438a-9f6a-9a7ee4453b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.935451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d46f2-21df-438a-9f6a-9a7ee4453b01 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.940571 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 791/1616] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.941462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d15a0-70d9-498a-bc30-e7bf8174cda5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.948664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 826/1617] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:06.950308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ebb96-8f1b-438a-9bac-b1f31553cf54 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.950772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ebb96-8f1b-438a-9bac-b1f31553cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.951312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ebb96-8f1b-438a-9bac-b1f31553cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.953476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d15a0-70d9-498a-bc30-e7bf8174cda5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.957304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b24ad3-9002-4314-a562-7f04cc147bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.958869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24ad3-9002-4314-a562-7f04cc147bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.959703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24ad3-9002-4314-a562-7f04cc147bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.960091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24ad3-9002-4314-a562-7f04cc147bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.970817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b24ad3-9002-4314-a562-7f04cc147bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.972883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b24ad3-9002-4314-a562-7f04cc147bfa service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.982341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a60ebb96-8f1b-438a-9bac-b1f31553cf54 None None] MFA Rules not processed for user `622daf1b9b2d4ebea6674b18ba15cbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.983392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 792/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:06.983860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a60ebb96-8f1b-438a-9bac-b1f31553cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.984753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f046b1-4354-4e7a-8a5d-e15e13cd7d63 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.985145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f046b1-4354-4e7a-8a5d-e15e13cd7d63 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.985505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f046b1-4354-4e7a-8a5d-e15e13cd7d63 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.987062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 793/1619] 10.222.0.45 () {54 vars in 962 bytes} [Thu Jul 21 04:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:06.987744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f046b1-4354-4e7a-8a5d-e15e13cd7d63 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.002167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f046b1-4354-4e7a-8a5d-e15e13cd7d63 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.008291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.009306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.009665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.010021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] PATH_INFO: `/v3/projects/956cc41e111a41ee86a249b21aa02c53/users/84c155dac7d44fbdb0c019f595598655/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.012153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956cc41e111a41ee86a249b21aa02c53, user_id=84c155dac7d44fbdb0c019f595598655, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.014959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.028115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 794/1620] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:06 2022] PUT /identity/v3/projects/956cc41e111a41ee86a249b21aa02c53/users/84c155dac7d44fbdb0c019f595598655/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:07.029054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.038408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.075837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 827/1621] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.075837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ebb96-8f1b-438a-9bac-b1f31553cf54 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.086193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ebb96-8f1b-438a-9bac-b1f31553cf54 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.109301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e39610-17c0-496e-a0ba-f87c171cb3c1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.113043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbaf83-b6ea-47c8-b77c-e08580a980ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.113807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbaf83-b6ea-47c8-b77c-e08580a980ca service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.114162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbaf83-b6ea-47c8-b77c-e08580a980ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.114751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbaf83-b6ea-47c8-b77c-e08580a980ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.158111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377af90-fedb-47d9-8199-861cfcc5a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.158794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377af90-fedb-47d9-8199-861cfcc5a64c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.159148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377af90-fedb-47d9-8199-861cfcc5a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.159499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377af90-fedb-47d9-8199-861cfcc5a64c admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.160268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377af90-fedb-47d9-8199-861cfcc5a64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.162864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377af90-fedb-47d9-8199-861cfcc5a64c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.188092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbaf83-b6ea-47c8-b77c-e08580a980ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.189755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbaf83-b6ea-47c8-b77c-e08580a980ca service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.201997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 828/1622] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.201997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d185009-c3e1-4573-8bf4-57504b41c9dd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.201997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d185009-c3e1-4573-8bf4-57504b41c9dd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.201997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d185009-c3e1-4573-8bf4-57504b41c9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.226499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 795/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:07.230293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052543e-1f9e-47c9-947c-6fc5aaa4066d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.230751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052543e-1f9e-47c9-947c-6fc5aaa4066d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.232446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052543e-1f9e-47c9-947c-6fc5aaa4066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.275928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0d185009-c3e1-4573-8bf4-57504b41c9dd None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.276688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2052543e-1f9e-47c9-947c-6fc5aaa4066d None None] MFA Rules not processed for user `84c155dac7d44fbdb0c019f595598655`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.277971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0d185009-c3e1-4573-8bf4-57504b41c9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.279092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2052543e-1f9e-47c9-947c-6fc5aaa4066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.310732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.326627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.384208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 796/1624] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.385264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052543e-1f9e-47c9-947c-6fc5aaa4066d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.405826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 829/1625] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.406821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d185009-c3e1-4573-8bf4-57504b41c9dd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.497506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052543e-1f9e-47c9-947c-6fc5aaa4066d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.504020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.505806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.506156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.506543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.507366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.510084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.521336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d185009-c3e1-4573-8bf4-57504b41c9dd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.536293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.537855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.539010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.540536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.542908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.548332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.553499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 797/1626] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.554492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.588960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 830/1627] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.592376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.618339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff3a03-98d8-410a-afd3-cf0aed475dd3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.660985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbee055-e646-4711-aa4a-66ad3fe1f293 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.669197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.669197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.669197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.669197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.771262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.771932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.772216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.773308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.801310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.805762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.812481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.846336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 798/1628] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:07.860918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.882267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.907725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.912383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.934260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 831/1629] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:07.935319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.039127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7633dae-5332-4b07-b0f1-91fd95cc76cf service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.046633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.047331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.047860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.048093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.049222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.054031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.091045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78df102-87da-45c5-95df-c5dc5dd98641 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.110123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 799/1630] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 307 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:08.115501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.119429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.120151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.120462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.122526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.123303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.125016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.142390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c7a5e-74e9-4caf-9977-97fec611e8fd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.150330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 832/1631] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.155257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.155958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.156575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.157585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.157729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.158875 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.162849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.194700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf3f4e-ada6-42ab-842e-19c22a4fc353 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.208763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 800/1632] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.215933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.216693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.219810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.223796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.224705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] PATH_INFO: `/v3/projects/844833e8a50c4ad4ab9f5cf90c78066a/users/4739bfeedc38448298414df2dab1c8f9/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.263213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185450ff-4432-4641-ab8c-a0a53b4c314a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.287853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.290270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.291219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.292250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=844833e8a50c4ad4ab9f5cf90c78066a, user_id=4739bfeedc38448298414df2dab1c8f9, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.292787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] PATH_INFO: `/v3/projects/a78752ab8d414f08859468098aa2838f/users/9def28ae9c624f43934312b0d2d5cc3d/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.297105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.344680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78752ab8d414f08859468098aa2838f, user_id=9def28ae9c624f43934312b0d2d5cc3d, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.348272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 833/1633] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/844833e8a50c4ad4ab9f5cf90c78066a/users/4739bfeedc38448298414df2dab1c8f9/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.348427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.349987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.413966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 801/1634] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/a78752ab8d414f08859468098aa2838f/users/9def28ae9c624f43934312b0d2d5cc3d/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.419972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.582548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea57f-cff7-4b0a-9f6a-6db951f86b3e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.620054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b5baf-f936-4bc7-a319-29c27329837a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.635504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.636389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.636524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.638553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.641021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.645260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.671976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 802/1635] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.675089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.701471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249a27d-fc93-4058-b6c2-ffa98d49536b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.717179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.719812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.720738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.721641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] PATH_INFO: `/v3/projects/a78752ab8d414f08859468098aa2838f/users/9def28ae9c624f43934312b0d2d5cc3d/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.727147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db428b-8167-4a45-8c1f-88340f74c826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.728186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78752ab8d414f08859468098aa2838f, user_id=9def28ae9c624f43934312b0d2d5cc3d, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.730912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db428b-8167-4a45-8c1f-88340f74c826 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.731322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db428b-8167-4a45-8c1f-88340f74c826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.731716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db428b-8167-4a45-8c1f-88340f74c826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.733195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db428b-8167-4a45-8c1f-88340f74c826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.733838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.737683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db428b-8167-4a45-8c1f-88340f74c826 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.765434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 803/1636] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/a78752ab8d414f08859468098aa2838f/users/9def28ae9c624f43934312b0d2d5cc3d/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.765644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 834/1637] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:18:08.775188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.778480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f25eaa-2ff3-40f0-8b61-dfbedf448ef2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.778783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f25eaa-2ff3-40f0-8b61-dfbedf448ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.779083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f25eaa-2ff3-40f0-8b61-dfbedf448ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.807277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:08.843529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-61f25eaa-2ff3-40f0-8b61-dfbedf448ef2 None None] MFA Rules not processed for user `9def28ae9c624f43934312b0d2d5cc3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:08.844740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61f25eaa-2ff3-40f0-8b61-dfbedf448ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:08.859226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:08.926430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603b590-05dd-4ada-a946-4da781bfddd6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.939023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89b9e-1664-4b6d-9948-498615bdea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.940156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89b9e-1664-4b6d-9948-498615bdea14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.940767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89b9e-1664-4b6d-9948-498615bdea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.941330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89b9e-1664-4b6d-9948-498615bdea14 admin admin] PATH_INFO: `/v3/projects/844833e8a50c4ad4ab9f5cf90c78066a/users/4739bfeedc38448298414df2dab1c8f9/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.946399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89b9e-1664-4b6d-9948-498615bdea14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844833e8a50c4ad4ab9f5cf90c78066a, user_id=4739bfeedc38448298414df2dab1c8f9, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.948998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89b9e-1664-4b6d-9948-498615bdea14 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.975944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 804/1638] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/844833e8a50c4ad4ab9f5cf90c78066a/users/4739bfeedc38448298414df2dab1c8f9/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.988667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b94ad-ad6d-4c44-a26c-fd5f7c91b5ef None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.989664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b94ad-ad6d-4c44-a26c-fd5f7c91b5ef None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.989664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b94ad-ad6d-4c44-a26c-fd5f7c91b5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.043900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cf6b94ad-ad6d-4c44-a26c-fd5f7c91b5ef None None] MFA Rules not processed for user `4739bfeedc38448298414df2dab1c8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.045388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cf6b94ad-ad6d-4c44-a26c-fd5f7c91b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.056840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 835/1639] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.067429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f25eaa-2ff3-40f0-8b61-dfbedf448ef2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.188903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 805/1640] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:09.217508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2bb70-2802-4d81-8ab4-c0926f59ba17 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.218030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2bb70-2802-4d81-8ab4-c0926f59ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.218385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2bb70-2802-4d81-8ab4-c0926f59ba17 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.220401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 806/1641] 10.222.0.45 () {54 vars in 962 bytes} [Thu Jul 21 04:18:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:09.220610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f25eaa-2ff3-40f0-8b61-dfbedf448ef2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.232753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2bb70-2802-4d81-8ab4-c0926f59ba17 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.347647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2bb70-2802-4d81-8ab4-c0926f59ba17 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.352220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e79b3-8b6c-4bd0-91a3-23b466fd9241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.353020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e79b3-8b6c-4bd0-91a3-23b466fd9241 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.353204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e79b3-8b6c-4bd0-91a3-23b466fd9241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.353858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e79b3-8b6c-4bd0-91a3-23b466fd9241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.369249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e79b3-8b6c-4bd0-91a3-23b466fd9241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.369249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e79b3-8b6c-4bd0-91a3-23b466fd9241 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.375114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.382166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 807/1642] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:09.383569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256402d5-c9d5-4634-ab40-2e6dac313e0b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.383871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256402d5-c9d5-4634-ab40-2e6dac313e0b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.384279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256402d5-c9d5-4634-ab40-2e6dac313e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.386288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.386595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.386909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.409669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-256402d5-c9d5-4634-ab40-2e6dac313e0b None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.412070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-256402d5-c9d5-4634-ab40-2e6dac313e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.491072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:09.528860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 808/1643] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.548509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528a19-57bd-4fe0-82a9-7c416ad57d2e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.548509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528a19-57bd-4fe0-82a9-7c416ad57d2e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.548839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.548945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528a19-57bd-4fe0-82a9-7c416ad57d2e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.548945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 809/1644] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jul 21 04:18:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:09.549084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.554633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24eda-7f89-445a-8ef4-ef7b183bb3e1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.554927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24eda-7f89-445a-8ef4-ef7b183bb3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.555792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:09.556730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24eda-7f89-445a-8ef4-ef7b183bb3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.584176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 836/1645] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:09.590093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4dd24eda-7f89-445a-8ef4-ef7b183bb3e1 None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.592377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4dd24eda-7f89-445a-8ef4-ef7b183bb3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.622656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 810/1646] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.688162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.710546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e1b1-855d-472e-a9d9-39eb53181b2b service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.727622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc002f2-0908-4688-91d2-beda84d25032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.729188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc002f2-0908-4688-91d2-beda84d25032 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.729188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc002f2-0908-4688-91d2-beda84d25032 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.729188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc002f2-0908-4688-91d2-beda84d25032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.744790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc002f2-0908-4688-91d2-beda84d25032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.746666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc002f2-0908-4688-91d2-beda84d25032 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.762738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 837/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:09.959882 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4949-06fc-4055-9fee-5b28275070b6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.960287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4949-06fc-4055-9fee-5b28275070b6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.960670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4949-06fc-4055-9fee-5b28275070b6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.963156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 811/1648] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jul 21 04:18:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:09.972758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a31a-aa96-4c49-8f2d-a051fa0eaf55 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.973233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a31a-aa96-4c49-8f2d-a051fa0eaf55 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.974187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a31a-aa96-4c49-8f2d-a051fa0eaf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.012405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0857a31a-aa96-4c49-8f2d-a051fa0eaf55 None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:10.014331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0857a31a-aa96-4c49-8f2d-a051fa0eaf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.038217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 838/1649] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:10.081869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4949-06fc-4055-9fee-5b28275070b6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.104052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4949-06fc-4055-9fee-5b28275070b6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.108987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.110000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.110242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.111440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.139553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.141874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.152725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857a31a-aa96-4c49-8f2d-a051fa0eaf55 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.177762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 812/1650] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:10.305419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857a31a-aa96-4c49-8f2d-a051fa0eaf55 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.317599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.318502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.318792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.319079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] PATH_INFO: `/v3/users/622daf1b9b2d4ebea6674b18ba15cbb9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.329224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] RBAC: Authorizing `identity:delete_user(user_id=622daf1b9b2d4ebea6674b18ba15cbb9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.333364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.362313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.388568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698551d6-e3f3-4ae6-bf78-9ed10d945b3c service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.401187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.402088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.402449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.402650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] PATH_INFO: `/v3/users/8d080955549c4c48a0ba6a573e88abe5` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.405736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d080955549c4c48a0ba6a573e88abe5)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.406782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:10.406782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jul 21 04:18:10.406782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: Jul 21 04:18:10.408020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.454290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622daf1b9b2d4ebea6674b18ba15cbb9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.493770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622daf1b9b2d4ebea6674b18ba15cbb9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.515805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622daf1b9b2d4ebea6674b18ba15cbb9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.549913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622daf1b9b2d4ebea6674b18ba15cbb9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.550595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6f0bd1c9-1dcc-4f8f-9634-e944e27f493a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622daf1b9b2d4ebea6674b18ba15cbb9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.562662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 839/1651] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:10 2022] DELETE /identity/v3/users/622daf1b9b2d4ebea6674b18ba15cbb9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:10.567077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.568184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.568672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.598289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:10.600415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.610638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d080955549c4c48a0ba6a573e88abe5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.651745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d080955549c4c48a0ba6a573e88abe5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.653809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d080955549c4c48a0ba6a573e88abe5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.676010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d080955549c4c48a0ba6a573e88abe5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.740791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4636df39-a6a2-41d7-a0d5-c51453164a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d080955549c4c48a0ba6a573e88abe5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:10.740791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 813/1652] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:10 2022] DELETE /identity/v3/users/8d080955549c4c48a0ba6a573e88abe5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:10.745582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:10.746039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.746039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.746039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.769738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 840/1653] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:10.772614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.775429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.789040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:10.790315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.794216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a830b6e-c91d-4d72-9576-69a33fe66805 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.897396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.898342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.898630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.898913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] PATH_INFO: `/v3/users/88167593943743f5a2f06548d79f55c0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.900787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88167593943743f5a2f06548d79f55c0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.902849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.948761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 814/1654] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:10.952850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.954322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.988701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88167593943743f5a2f06548d79f55c0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.018149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88167593943743f5a2f06548d79f55c0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.040194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88167593943743f5a2f06548d79f55c0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.051711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88167593943743f5a2f06548d79f55c0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.052867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88167593943743f5a2f06548d79f55c0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.064073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:11.064252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 841/1655] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:10 2022] DELETE /identity/v3/users/88167593943743f5a2f06548d79f55c0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:11.065195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:11.070967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:11.101065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dff08e-f7a7-48ab-8fbb-5b7fd539affb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:11.206413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6671f5-00d1-4a38-b2a9-7413db826a61 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:11.214640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cfee9-3c1a-410e-9c72-9223cd5920ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:11.215453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cfee9-3c1a-410e-9c72-9223cd5920ab service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.215844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cfee9-3c1a-410e-9c72-9223cd5920ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.216227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cfee9-3c1a-410e-9c72-9223cd5920ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:11.218722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dc8cfee9-3c1a-410e-9c72-9223cd5920ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:11.219388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:11.220073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.220367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.220637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:11.230493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:11.370979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cfee9-3c1a-410e-9c72-9223cd5920ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:11.372353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:11.372482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cfee9-3c1a-410e-9c72-9223cd5920ab service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:11.399377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 815/1656] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:11.403210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43a48-1063-4e56-b6dd-65ab29a933fb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.403662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43a48-1063-4e56-b6dd-65ab29a933fb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.404107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c43a48-1063-4e56-b6dd-65ab29a933fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:11.457367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-39c43a48-1063-4e56-b6dd-65ab29a933fb None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:11.459102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-39c43a48-1063-4e56-b6dd-65ab29a933fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:11.476847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 816/1657] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:11.555646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:11.557149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:11.563732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c43a48-1063-4e56-b6dd-65ab29a933fb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:11.578876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c43a48-1063-4e56-b6dd-65ab29a933fb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:11.594976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 842/1658] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:11.595647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e039-7106-4da0-b2f9-c7cfcd71cfc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:11.596319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e039-7106-4da0-b2f9-c7cfcd71cfc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.596609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e039-7106-4da0-b2f9-c7cfcd71cfc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.596918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e039-7106-4da0-b2f9-c7cfcd71cfc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:11.617274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89e039-7106-4da0-b2f9-c7cfcd71cfc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:11.618753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89e039-7106-4da0-b2f9-c7cfcd71cfc5 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:11.650608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 817/1659] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:11.748788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:11.750860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:11.768328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877831-80d7-4302-85e5-9a7c8429883b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:11.780140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:11.781815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.782232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.782791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] PATH_INFO: `/v3/users/a18b123f65cc40aa810227421a43bc22` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:11.784543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18b123f65cc40aa810227421a43bc22)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:11.788938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:11.875530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18b123f65cc40aa810227421a43bc22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.912763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18b123f65cc40aa810227421a43bc22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.924143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18b123f65cc40aa810227421a43bc22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.938420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18b123f65cc40aa810227421a43bc22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.939488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18b123f65cc40aa810227421a43bc22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:11.946780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 843/1660] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:11 2022] DELETE /identity/v3/users/a18b123f65cc40aa810227421a43bc22 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:11.951605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.952005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.952397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:12.001486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:12.006693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:12.195337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 818/1661] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:12.257883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:12.259433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:12.411011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa833c51-5185-4f52-9b11-b49cc6386fe9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:12.425625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:12.427028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:12.427574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:12.428912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:12.445164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:12.455562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:12.498916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 844/1662] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:14.107917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:14.109487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:14.131153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad3766-dc20-43e9-9c3c-8decb23c9d92 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:14.141114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:14.142007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:14.142327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:14.142532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] PATH_INFO: `/v3/projects/6a1bcc85aab44cfbb5c491c40ecf1c2f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:14.146244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1bcc85aab44cfbb5c491c40ecf1c2f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:14.148253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:14.228857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:14.285699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1bcc85aab44cfbb5c491c40ecf1c2f', 'request_id': 'req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.309673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1bcc85aab44cfbb5c491c40ecf1c2f', 'request_id': 'req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.321258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1bcc85aab44cfbb5c491c40ecf1c2f', 'request_id': 'req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.338622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:14.341353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:14.352394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] The token cache is being invalidate because project 6a1bcc85aab44cfbb5c491c40ecf1c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:14.358483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.360158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.367225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 819/1663] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:14 2022] DELETE /identity/v3/projects/6a1bcc85aab44cfbb5c491c40ecf1c2f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:14.373754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:14.375493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:14.378532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b19db3-bd63-497a-9d0e-46d53ad1399d service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:14.494394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:14.541329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:14.541995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:14.542431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:14.542855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] PATH_INFO: `/v3/projects/8d2c5e6dc4014fefb4b386a628a8e3fe` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:14.546185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2c5e6dc4014fefb4b386a628a8e3fe)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:14.551305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:14.551305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jul 21 04:18:14.551305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: Jul 21 04:18:14.555241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:14.558785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb04b7f-013d-4daa-99a7-e76a5b8aacaf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:14.575014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:14.576184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:14.576806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:14.577345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] PATH_INFO: `/v3/users/84c155dac7d44fbdb0c019f595598655` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:14.578788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c155dac7d44fbdb0c019f595598655)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:14.582777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:14.723513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c155dac7d44fbdb0c019f595598655'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.733951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2c5e6dc4014fefb4b386a628a8e3fe', 'request_id': 'req-e55883ed-9fa7-42dd-9886-fb965f7e5db5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.757439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2c5e6dc4014fefb4b386a628a8e3fe', 'request_id': 'req-e55883ed-9fa7-42dd-9886-fb965f7e5db5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.765282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2c5e6dc4014fefb4b386a628a8e3fe', 'request_id': 'req-e55883ed-9fa7-42dd-9886-fb965f7e5db5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.768693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c155dac7d44fbdb0c019f595598655'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.770613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c155dac7d44fbdb0c019f595598655'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.787977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c155dac7d44fbdb0c019f595598655'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.816377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a9d3dd83-cdd1-44a3-a3fa-7293434d2c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c155dac7d44fbdb0c019f595598655'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.819140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] The token cache is being invalidate because project 8d2c5e6dc4014fefb4b386a628a8e3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:14.819440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.820132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:14.825735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 845/1664] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:14 2022] DELETE /identity/v3/projects/8d2c5e6dc4014fefb4b386a628a8e3fe => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:14.829125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:14.832890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:14.845856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 820/1665] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:14 2022] DELETE /identity/v3/users/84c155dac7d44fbdb0c019f595598655 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:14.845856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:14.849311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:14.849931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:14.916793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:14.919038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:14.968589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55883ed-9fa7-42dd-9886-fb965f7e5db5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:14.972952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:15.069231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 821/1666] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:15.075804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:15.075804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.097165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48894885-17dd-49e0-abb5-64aa0af829e1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:15.117892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:15.119537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.119992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.120454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] PATH_INFO: `/v3/projects/cdaecfe27e7643848f2092bce528da22` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.123844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdaecfe27e7643848f2092bce528da22)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:15.128717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:15.160180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:15.161756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.165388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.165809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] PATH_INFO: `/v3/projects/13d7dcf31b8a4cabba8942339102a83f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.168527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d7dcf31b8a4cabba8942339102a83f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:15.178971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:15.255050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:15.263075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdaecfe27e7643848f2092bce528da22', 'request_id': 'req-43498b60-69ab-4cee-8cde-8fa679830354'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.280837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdaecfe27e7643848f2092bce528da22', 'request_id': 'req-43498b60-69ab-4cee-8cde-8fa679830354'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.298407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdaecfe27e7643848f2092bce528da22', 'request_id': 'req-43498b60-69ab-4cee-8cde-8fa679830354'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.324120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d7dcf31b8a4cabba8942339102a83f', 'request_id': 'req-3fb18cc0-3983-40a7-a1f3-9d79172ce324'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.329512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] The token cache is being invalidate because project cdaecfe27e7643848f2092bce528da22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:15.331402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.333367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-43498b60-69ab-4cee-8cde-8fa679830354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.342957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 822/1667] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:15 2022] DELETE /identity/v3/projects/cdaecfe27e7643848f2092bce528da22 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:15.344695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.346152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d7dcf31b8a4cabba8942339102a83f', 'request_id': 'req-3fb18cc0-3983-40a7-a1f3-9d79172ce324'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.346673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.346673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.358242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d7dcf31b8a4cabba8942339102a83f', 'request_id': 'req-3fb18cc0-3983-40a7-a1f3-9d79172ce324'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.399071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:15.401340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.427153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] The token cache is being invalidate because project 13d7dcf31b8a4cabba8942339102a83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:15.427861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.432697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.435383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 846/1668] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:14 2022] DELETE /identity/v3/projects/13d7dcf31b8a4cabba8942339102a83f => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:15.436505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:15.439823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.550514 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 823/1669] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:15.554636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:15.554636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.571394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a086-3721-4d02-a570-6d6d6f53b913 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:15.580868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:15.581912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.581912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.582157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] PATH_INFO: `/v3/users/9def28ae9c624f43934312b0d2d5cc3d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.591015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9def28ae9c624f43934312b0d2d5cc3d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:15.601147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:15.679389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb18cc0-3983-40a7-a1f3-9d79172ce324 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:15.697754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:15.698683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.699203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.699754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] PATH_INFO: `/v3/users/4739bfeedc38448298414df2dab1c8f9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.702105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4739bfeedc38448298414df2dab1c8f9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:15.704275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:15.740991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9def28ae9c624f43934312b0d2d5cc3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.742822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:15.790987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9def28ae9c624f43934312b0d2d5cc3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.791787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9def28ae9c624f43934312b0d2d5cc3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.805966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4739bfeedc38448298414df2dab1c8f9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.811598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9def28ae9c624f43934312b0d2d5cc3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.836111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4739bfeedc38448298414df2dab1c8f9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.837571 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9def28ae9c624f43934312b0d2d5cc3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.850395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4739bfeedc38448298414df2dab1c8f9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.851531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 824/1670] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:15 2022] DELETE /identity/v3/users/9def28ae9c624f43934312b0d2d5cc3d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:15.852424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:15.854591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.866464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4739bfeedc38448298414df2dab1c8f9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.868868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4739bfeedc38448298414df2dab1c8f9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.890714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 847/1671] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:15 2022] DELETE /identity/v3/users/4739bfeedc38448298414df2dab1c8f9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:16.046693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae2a5-31a6-433c-8620-43059c27f4b1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.156601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.158417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.159418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.159851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.161586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:16.162080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.164339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.180150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 825/1672] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:16.185795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.189559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.214811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f26f3-1341-41c4-9462-438a2f9bcb1d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.225740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.226439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.226729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.227014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.227723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.235524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.298632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 848/1673] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:16.300208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.318802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad180a-3423-406a-b89a-429777c902f8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.445901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.451452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.451955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.452480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.453647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.469998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.484735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:16.514249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.530629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 826/1674] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/users => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:16.539447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be5fa2-6384-4cc0-ba52-34959ad40093 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.546532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.547416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.547953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.548419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.549835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.552340 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.554639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:16.570999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.573225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.604266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 849/1675] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:16.605511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.607930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ccf50-e0cb-4378-a78d-16f1736df4bb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.623446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.624791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.626080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.627395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] PATH_INFO: `/v3/projects/956cc41e111a41ee86a249b21aa02c53` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.630050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] RBAC: Authorizing `identity:delete_project(project_id=956cc41e111a41ee86a249b21aa02c53)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.633786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c73207-6565-4269-baee-8ade87e772e5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.635847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.646753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.648595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.648912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.656160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.657136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.663699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.697576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 850/1676] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:16.702251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.725994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201afe-f612-4494-badb-0eee73549679 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.737582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956cc41e111a41ee86a249b21aa02c53', 'request_id': 'req-7a98ad0b-0948-4033-805c-79755789280c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.750898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956cc41e111a41ee86a249b21aa02c53', 'request_id': 'req-7a98ad0b-0948-4033-805c-79755789280c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.774060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956cc41e111a41ee86a249b21aa02c53', 'request_id': 'req-7a98ad0b-0948-4033-805c-79755789280c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.789168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] The token cache is being invalidate because project 956cc41e111a41ee86a249b21aa02c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:16.789486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.790141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7a98ad0b-0948-4033-805c-79755789280c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.795239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 827/1677] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:16 2022] DELETE /identity/v3/projects/956cc41e111a41ee86a249b21aa02c53 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:16.795239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e898d1-07f9-4c4b-90da-7232ed140daa None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.795239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e898d1-07f9-4c4b-90da-7232ed140daa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.795239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e898d1-07f9-4c4b-90da-7232ed140daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.829852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-45e898d1-07f9-4c4b-90da-7232ed140daa None None] MFA Rules not processed for user `a0b60457ec54498f89d72e69ad580fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:16.831249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-45e898d1-07f9-4c4b-90da-7232ed140daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.876862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6b341-2364-4d7f-864f-a6c06f7733f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.877791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6b341-2364-4d7f-864f-a6c06f7733f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.878082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6b341-2364-4d7f-864f-a6c06f7733f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.878365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6b341-2364-4d7f-864f-a6c06f7733f7 admin admin] PATH_INFO: `/v3/projects/03712862689a45c7a3b6e2ea32c71946/users/1b7dcbb86eaf4388a343cc25771ba164/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.911285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6b341-2364-4d7f-864f-a6c06f7733f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03712862689a45c7a3b6e2ea32c71946, user_id=1b7dcbb86eaf4388a343cc25771ba164, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.914264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6b341-2364-4d7f-864f-a6c06f7733f7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.924615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 828/1678] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:16.936694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501ae8-aef6-441f-a154-b2e8d1dd7074 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.937111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501ae8-aef6-441f-a154-b2e8d1dd7074 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.937383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501ae8-aef6-441f-a154-b2e8d1dd7074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.952512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 851/1679] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:16 2022] PUT /identity/v3/projects/03712862689a45c7a3b6e2ea32c71946/users/1b7dcbb86eaf4388a343cc25771ba164/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:16.954010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.954271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.954555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.963533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-65501ae8-aef6-441f-a154-b2e8d1dd7074 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:16.965243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-65501ae8-aef6-441f-a154-b2e8d1dd7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.995380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] MFA Rules not processed for user `a0b60457ec54498f89d72e69ad580fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:16.998852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.059173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 829/1680] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:17.060690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855609b-e271-4c7e-a35a-93f0451d5b1f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.061029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855609b-e271-4c7e-a35a-93f0451d5b1f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.061636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855609b-e271-4c7e-a35a-93f0451d5b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.083574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6855609b-e271-4c7e-a35a-93f0451d5b1f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:17.085088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6855609b-e271-4c7e-a35a-93f0451d5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.092042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 852/1681] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:17.093624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.095153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.100063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 830/1682] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:17.104515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.105002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.105299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.113471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:17.116096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29f80-c511-440b-b939-0dbc9d31c178 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.124721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.125883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.126333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.126768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] PATH_INFO: `/v3/projects/844833e8a50c4ad4ab9f5cf90c78066a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.128471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844833e8a50c4ad4ab9f5cf90c78066a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.130805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.132851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:17.134080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.146065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 831/1683] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:17.147297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.148711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.231614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d73b7-9ccf-4051-b17e-33085f0fe7ed None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.235808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.236506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.236801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.237651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.252323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.253347 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.282599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 832/1684] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:17.285225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.288674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.311721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844833e8a50c4ad4ab9f5cf90c78066a', 'request_id': 'req-784d8309-4df7-46dc-955f-4bef277d6af1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.328667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844833e8a50c4ad4ab9f5cf90c78066a', 'request_id': 'req-784d8309-4df7-46dc-955f-4bef277d6af1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.344452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844833e8a50c4ad4ab9f5cf90c78066a', 'request_id': 'req-784d8309-4df7-46dc-955f-4bef277d6af1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.358803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:17.370655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] The token cache is being invalidate because project 844833e8a50c4ad4ab9f5cf90c78066a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:17.371075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.372189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.375152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 853/1685] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:17 2022] DELETE /identity/v3/projects/844833e8a50c4ad4ab9f5cf90c78066a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:17.376760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.379197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.438321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc629af-5988-416f-8d29-d3e32bcf6d86 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.503503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d8309-4df7-46dc-955f-4bef277d6af1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.512567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59f9e-c158-4f4a-bfbf-c411ef373c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.513288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59f9e-c158-4f4a-bfbf-c411ef373c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.513580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59f9e-c158-4f4a-bfbf-c411ef373c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.514575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59f9e-c158-4f4a-bfbf-c411ef373c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.515237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab59f9e-c158-4f4a-bfbf-c411ef373c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:17.515487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab59f9e-c158-4f4a-bfbf-c411ef373c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.523287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab59f9e-c158-4f4a-bfbf-c411ef373c9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.540917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 854/1686] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:17.542940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0ce3-22a0-4ed3-9409-6f80908fd417 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.543240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0ce3-22a0-4ed3-9409-6f80908fd417 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.543633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f0ce3-22a0-4ed3-9409-6f80908fd417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.592447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.593225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.593519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.593862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.599850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.607362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-859f0ce3-22a0-4ed3-9409-6f80908fd417 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:17.609071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-859f0ce3-22a0-4ed3-9409-6f80908fd417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.649089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 855/1687] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:17.650689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0ce3-22a0-4ed3-9409-6f80908fd417 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.674074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f0ce3-22a0-4ed3-9409-6f80908fd417 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.709833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c445e-b211-4785-b3b0-676d3ee01a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.712924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c445e-b211-4785-b3b0-676d3ee01a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.714570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c445e-b211-4785-b3b0-676d3ee01a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.715547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c445e-b211-4785-b3b0-676d3ee01a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.716393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c445e-b211-4785-b3b0-676d3ee01a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.724367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c445e-b211-4785-b3b0-676d3ee01a92 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.738176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:17.814205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.816275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.819610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 856/1688] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:17.821128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69cf1-b3a8-4562-8863-04f58943dcb8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.821425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69cf1-b3a8-4562-8863-04f58943dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.821720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69cf1-b3a8-4562-8863-04f58943dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.833119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 833/1689] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:17.834177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.851154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b35b6c-4504-4829-95a1-68e4ecb61043 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.862364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5dd69cf1-b3a8-4562-8863-04f58943dcb8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:17.864379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5dd69cf1-b3a8-4562-8863-04f58943dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.967472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 857/1690] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:17.972111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69cf1-b3a8-4562-8863-04f58943dcb8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.983593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.984486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.984735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69cf1-b3a8-4562-8863-04f58943dcb8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.985000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.985410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.986622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.988680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.006861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.007808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.008246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.008660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.010489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:18.010979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.012773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.030389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 834/1691] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:18.034628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.049278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c185fa1-7d2b-4075-9daf-5fa92298be9b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.071855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.072847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 858/1692] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:18.073438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.073833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.074300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.075184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.077222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.077463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.100208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540bec-fb29-452b-bb53-e64ccd4b2e40 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.102235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 835/1693] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:18.107235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.109477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.131798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.132046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.132333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.138594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.146902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.157380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d15bd-1189-4888-8477-55abd3f20ebf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.172513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.172752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.173073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.173363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.174116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.176161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.201673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 859/1694] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:18.202078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 836/1695] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:18.205751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.210667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.231002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2720bbf-4831-46d7-a1f6-ed4f0af48377 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.280808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:18.319044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.321243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.321767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.322129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] PATH_INFO: `/v3/projects/e0eb634741cc4308a990a252aa56f8c7/users/0213340a4b23415fa27a8134f4ea50df/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.338773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49e1e-77d8-4ccb-8657-2ad89ee9968b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.345037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa6d2-8325-4d92-be9c-b2622ea8e9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.345820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa6d2-8325-4d92-be9c-b2622ea8e9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.346590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa6d2-8325-4d92-be9c-b2622ea8e9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.346954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa6d2-8325-4d92-be9c-b2622ea8e9c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.348048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa6d2-8325-4d92-be9c-b2622ea8e9c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.354521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa6d2-8325-4d92-be9c-b2622ea8e9c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.354695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0eb634741cc4308a990a252aa56f8c7, user_id=0213340a4b23415fa27a8134f4ea50df, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.360160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.388813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 837/1696] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:18 2022] PUT /identity/v3/projects/e0eb634741cc4308a990a252aa56f8c7/users/0213340a4b23415fa27a8134f4ea50df/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:18.389732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 860/1697] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:18.393381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.402042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc7f9-100b-4f96-9e33-5b4e2392c764 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.402336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc7f9-100b-4f96-9e33-5b4e2392c764 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.402632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc7f9-100b-4f96-9e33-5b4e2392c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.462688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:18.467047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f98bc7f9-100b-4f96-9e33-5b4e2392c764 None None] MFA Rules not processed for user `0213340a4b23415fa27a8134f4ea50df`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:18.469492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f98bc7f9-100b-4f96-9e33-5b4e2392c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:18.546804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3ea05-e6fe-4764-9906-5f86fcda8b48 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.553542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.554605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.555076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.555529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.556416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.558928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.577703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 838/1698] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:18.582296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.595312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a73c-24f4-4ddf-a7f5-d26ccafb2749 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.604629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.605687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.606263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.606898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.607742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 861/1699] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:18.608695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.610659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.612472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc7f9-100b-4f96-9e33-5b4e2392c764 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.626366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc7f9-100b-4f96-9e33-5b4e2392c764 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.628057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 839/1700] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:18.633428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.637500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.639203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.642875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.643295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.644284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.647659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.648460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b4aae-2a33-43c1-8bc9-fc30738f3cc1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.675793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b220a06-9d1b-484e-a874-33de5b700bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.676659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220a06-9d1b-484e-a874-33de5b700bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.676999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220a06-9d1b-484e-a874-33de5b700bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.677288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220a06-9d1b-484e-a874-33de5b700bad admin admin] PATH_INFO: `/v3/projects/a4304172cc9d41a88a8c42e9e5bf3930/users/5ab0b8974bc04185b6b4679a576cffc4/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.716938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 862/1701] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:18.718129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.729710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b220a06-9d1b-484e-a874-33de5b700bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4304172cc9d41a88a8c42e9e5bf3930, user_id=5ab0b8974bc04185b6b4679a576cffc4, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.733369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b220a06-9d1b-484e-a874-33de5b700bad admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.761934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 840/1702] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:18 2022] PUT /identity/v3/projects/a4304172cc9d41a88a8c42e9e5bf3930/users/5ab0b8974bc04185b6b4679a576cffc4/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:18.773870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6429-a106-45e0-abbc-6ad39966acde None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.774352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6429-a106-45e0-abbc-6ad39966acde None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.774879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6429-a106-45e0-abbc-6ad39966acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.810485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d01f6429-a106-45e0-abbc-6ad39966acde None None] MFA Rules not processed for user `5ab0b8974bc04185b6b4679a576cffc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:18.812069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d01f6429-a106-45e0-abbc-6ad39966acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:18.846351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a9020-f820-4c7a-ae78-d86595aa097d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.899649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:18.920038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 841/1703] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:18.922465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a805-fab6-48b7-b140-6108d14dfb2f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.923030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a805-fab6-48b7-b140-6108d14dfb2f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.923578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a805-fab6-48b7-b140-6108d14dfb2f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.925188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 842/1704] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jul 21 04:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:18.932079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a805-fab6-48b7-b140-6108d14dfb2f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.969907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bb10c-8f70-4598-b241-9e9245e7302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.973660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb10c-8f70-4598-b241-9e9245e7302a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.974163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb10c-8f70-4598-b241-9e9245e7302a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.974745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bb10c-8f70-4598-b241-9e9245e7302a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.975774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bb10c-8f70-4598-b241-9e9245e7302a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.978976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bb10c-8f70-4598-b241-9e9245e7302a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.010441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 863/1705] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:19.012063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489f4ae-c9a7-4b64-8b85-06b94f7e956e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.012628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489f4ae-c9a7-4b64-8b85-06b94f7e956e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.013076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489f4ae-c9a7-4b64-8b85-06b94f7e956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.064730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a805-fab6-48b7-b140-6108d14dfb2f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.065025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8489f4ae-c9a7-4b64-8b85-06b94f7e956e None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:19.066238 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8489f4ae-c9a7-4b64-8b85-06b94f7e956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.072668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad254ac-c947-4406-8693-9921f2a5444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.073666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad254ac-c947-4406-8693-9921f2a5444c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.074067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad254ac-c947-4406-8693-9921f2a5444c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.074463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad254ac-c947-4406-8693-9921f2a5444c admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.075345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad254ac-c947-4406-8693-9921f2a5444c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.077394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad254ac-c947-4406-8693-9921f2a5444c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.111126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:19.126974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 843/1706] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/projects => generated 363 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:19.128597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.129022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.129932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.135663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 864/1707] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:19.136871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489f4ae-c9a7-4b64-8b85-06b94f7e956e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.150009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489f4ae-c9a7-4b64-8b85-06b94f7e956e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.188326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] MFA Rules not processed for user `1b7dcbb86eaf4388a343cc25771ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:19.189479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.255794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.256719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.257227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.257647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.258548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.261330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.277109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 865/1708] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:19.278276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.295428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bc3cb-b2dd-4402-ba0f-5e9f1f2c9d46 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.297782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 844/1709] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:19.298725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.300074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.311219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.311917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.312204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.312485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.313395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.318242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.359118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 866/1710] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/users => generated 288 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:19.361232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.380888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c658da-6d21-4a59-8d47-b96bf6671976 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.385824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19513-6123-4e23-a5bd-90f23b212389 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.388932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.390129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.392876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.392876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.392876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.393627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.393840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.393935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] PATH_INFO: `/v3/projects/b7af952df0f34b7cb71d37ac52c2af4e/users/fde7e1404c004ec3af67dc425a807632/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.410428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.411947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.430591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7af952df0f34b7cb71d37ac52c2af4e, user_id=fde7e1404c004ec3af67dc425a807632, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.434331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.451516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 845/1711] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:19.452525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 867/1712] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:19 2022] PUT /identity/v3/projects/b7af952df0f34b7cb71d37ac52c2af4e/users/fde7e1404c004ec3af67dc425a807632/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:19.453358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.456639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.457596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.492857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a3c9d-0acb-4892-8ef4-5248c78e54e3 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.494263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:19.559770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bbf4a-2cfd-49f0-88e0-bb640805f0c6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.572545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.573743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.574227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.574513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.576184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.577851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.605960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 868/1713] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:19.605960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.625778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.626051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c3890-314c-4c13-82e1-d3eb95d1cc60 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.626477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.626477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.626477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.626477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.628589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.649010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.649816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.650154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.655470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.656417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.658542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.680207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 846/1714] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/projects => generated 405 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:19.680389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.685187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 869/1715] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:19.686541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.688951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.706393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a85c1-0fd8-4604-ac11-32bcf737f63e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.737523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:19.814764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ef13-beef-4b92-bdc1-1841d51dbae7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.836238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.837297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.839725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.840127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] PATH_INFO: `/v3/projects/fc610819cc69426d9b35a405e7a9ef8c/users/b1ecabd77bb343d6b8906678b5911de7/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.842815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.843992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.847058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.847622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] PATH_INFO: `/v3/projects/a78752ab8d414f08859468098aa2838f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.851372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78752ab8d414f08859468098aa2838f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.857603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.882165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc610819cc69426d9b35a405e7a9ef8c, user_id=b1ecabd77bb343d6b8906678b5911de7, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.885805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.905331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 847/1716] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:19 2022] PUT /identity/v3/projects/fc610819cc69426d9b35a405e7a9ef8c/users/b1ecabd77bb343d6b8906678b5911de7/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:19.906998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.979247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78752ab8d414f08859468098aa2838f', 'request_id': 'req-5659edbf-19a4-42b8-ae9e-fa31944062d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.988168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14c6ca-7908-4620-b424-f21bc6cbf22f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.997866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78752ab8d414f08859468098aa2838f', 'request_id': 'req-5659edbf-19a4-42b8-ae9e-fa31944062d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.010831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78752ab8d414f08859468098aa2838f', 'request_id': 'req-5659edbf-19a4-42b8-ae9e-fa31944062d6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.029743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] The token cache is being invalidate because project a78752ab8d414f08859468098aa2838f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:20.030192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.031285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.034321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 870/1717] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:19 2022] DELETE /identity/v3/projects/a78752ab8d414f08859468098aa2838f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:20.035259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.038064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.079845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.081297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.081748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.082228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.083635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.085930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.097318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:20.130176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 848/1718] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/users => generated 309 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:20.133384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.140711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.193642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659edbf-19a4-42b8-ae9e-fa31944062d6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.198226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee23e5d-95f4-4a45-b7e2-710861f957ed admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.199937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bce1d-4ddd-4ae8-b35c-d88ff146cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.201130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bce1d-4ddd-4ae8-b35c-d88ff146cccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.201539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bce1d-4ddd-4ae8-b35c-d88ff146cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.202249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bce1d-4ddd-4ae8-b35c-d88ff146cccc admin admin] PATH_INFO: `/v3/projects/b7af952df0f34b7cb71d37ac52c2af4e/users/fde7e1404c004ec3af67dc425a807632/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.204719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bce1d-4ddd-4ae8-b35c-d88ff146cccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7af952df0f34b7cb71d37ac52c2af4e, user_id=fde7e1404c004ec3af67dc425a807632, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.208320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bce1d-4ddd-4ae8-b35c-d88ff146cccc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.222122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 871/1719] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:20 2022] PUT /identity/v3/projects/b7af952df0f34b7cb71d37ac52c2af4e/users/fde7e1404c004ec3af67dc425a807632/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:20.222772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.225402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.227058 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.227395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a21a-caaa-45b1-a618-e329e9609056 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.227716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.227985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a21a-caaa-45b1-a618-e329e9609056 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.228404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a21a-caaa-45b1-a618-e329e9609056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.229500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.234287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.251171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7f18a21a-caaa-45b1-a618-e329e9609056 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:20.252638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f18a21a-caaa-45b1-a618-e329e9609056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.271502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 849/1720] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:20.284284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.303039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.334710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0df37-9ed6-400f-a034-b770fa268121 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.354098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 872/1721] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:20.354754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25277cb3-236d-48db-9966-860d8fe414ca None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.355159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25277cb3-236d-48db-9966-860d8fe414ca None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.355948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25277cb3-236d-48db-9966-860d8fe414ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.365205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:20.406983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.407738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.408370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.408370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.409486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.417396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.428941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-25277cb3-236d-48db-9966-860d8fe414ca None None] MFA Rules not processed for user `fde7e1404c004ec3af67dc425a807632`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:20.430324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-25277cb3-236d-48db-9966-860d8fe414ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.453177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 850/1722] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:20.454574 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.497769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e99fa-d869-4900-af38-d0e8a25730b3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.511537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b7ca4-9564-4e1b-89f0-67712b23bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.513411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7ca4-9564-4e1b-89f0-67712b23bb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.513589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7ca4-9564-4e1b-89f0-67712b23bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.514936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7ca4-9564-4e1b-89f0-67712b23bb28 admin admin] PATH_INFO: `/v3/projects/fc610819cc69426d9b35a405e7a9ef8c/users/b1ecabd77bb343d6b8906678b5911de7/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.521909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b7ca4-9564-4e1b-89f0-67712b23bb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc610819cc69426d9b35a405e7a9ef8c, user_id=b1ecabd77bb343d6b8906678b5911de7, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.524621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b7ca4-9564-4e1b-89f0-67712b23bb28 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.563241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 851/1723] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:20 2022] PUT /identity/v3/projects/fc610819cc69426d9b35a405e7a9ef8c/users/b1ecabd77bb343d6b8906678b5911de7/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:20.565853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2bef8-28b9-4bc5-9a45-f89952ea74b3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.566962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2bef8-28b9-4bc5-9a45-f89952ea74b3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.567359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2bef8-28b9-4bc5-9a45-f89952ea74b3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.572424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 852/1724] 10.222.0.45 () {54 vars in 961 bytes} [Thu Jul 21 04:18:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:20.574971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ead92-0d76-46de-bf27-39f6c9780734 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.576160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ead92-0d76-46de-bf27-39f6c9780734 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.576458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ead92-0d76-46de-bf27-39f6c9780734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.623128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-532ead92-0d76-46de-bf27-39f6c9780734 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:20.624361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-532ead92-0d76-46de-bf27-39f6c9780734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.630406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 873/1725] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:20.632921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25277cb3-236d-48db-9966-860d8fe414ca None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.684641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25277cb3-236d-48db-9966-860d8fe414ca None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.778887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 853/1726] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:20.782230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc8af-6dff-46f5-a5c3-bc315c559aff None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.782660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc8af-6dff-46f5-a5c3-bc315c559aff None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.783729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc8af-6dff-46f5-a5c3-bc315c559aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.802228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:20.828535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-56efc8af-6dff-46f5-a5c3-bc315c559aff None None] MFA Rules not processed for user `a0b60457ec54498f89d72e69ad580fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:20.829534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd4cb5-bef3-46cd-9de6-7800d2134798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.830091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-56efc8af-6dff-46f5-a5c3-bc315c559aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.830451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd4cb5-bef3-46cd-9de6-7800d2134798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.830741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd4cb5-bef3-46cd-9de6-7800d2134798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.831028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd4cb5-bef3-46cd-9de6-7800d2134798 admin admin] PATH_INFO: `/v3/projects/dc3a1791b2fb47b1b9c0d50312d822bc/users/52e8384a41584f1399529cca63655457/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.873614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd4cb5-bef3-46cd-9de6-7800d2134798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3a1791b2fb47b1b9c0d50312d822bc, user_id=52e8384a41584f1399529cca63655457, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.880933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd4cb5-bef3-46cd-9de6-7800d2134798 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.909365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 874/1727] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:20 2022] PUT /identity/v3/projects/dc3a1791b2fb47b1b9c0d50312d822bc/users/52e8384a41584f1399529cca63655457/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:20.911758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.912060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.912347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.992061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] MFA Rules not processed for user `b1ecabd77bb343d6b8906678b5911de7`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:20.995083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.999070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 854/1728] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.000658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf743fc-f5eb-4b95-9885-26e6962cee32 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.003480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf743fc-f5eb-4b95-9885-26e6962cee32 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.004160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf743fc-f5eb-4b95-9885-26e6962cee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.075493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3cf743fc-f5eb-4b95-9885-26e6962cee32 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:21.076891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3cf743fc-f5eb-4b95-9885-26e6962cee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.195793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 875/1729] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.197811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.199178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:21.199783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.237517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 855/1730] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.238485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf743fc-f5eb-4b95-9885-26e6962cee32 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.330331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50694-808c-4779-9612-7e8c13b3d730 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.337937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.339272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.340379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.340666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.370115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf743fc-f5eb-4b95-9885-26e6962cee32 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.382693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.384697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.385014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.385945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.387093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:21.387093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.391751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.419492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 856/1731] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:21.420566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.439363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0207313-e169-4edb-889c-035780a33aa6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.452027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.452630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.452943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.453224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.456349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.462684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.471295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.472776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.489824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 857/1732] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:21.489824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.494916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.510257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 876/1733] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:21.513680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.534156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:21.543917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152ce3-e84a-4b1e-9e74-2a3596e407eb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.548367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce3fb8-5098-4213-9d7d-17fdf84fca09 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.553578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.555647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.556107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.558163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.563557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.572372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.572677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.573275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.583733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.586902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.588166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.610200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.611829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.613399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 858/1734] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:21.618910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.648532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 877/1735] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:21.662990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.683838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eede85-062c-43b0-b558-c36f1a83c2fe service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.702899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.705455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.705746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.706034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.715098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.717213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.727461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad74bf-608b-4a4a-8a54-353d98a60e0e service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.744607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.747057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.747558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.748063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] PATH_INFO: `/v3/projects/dc3a1791b2fb47b1b9c0d50312d822bc/users/52e8384a41584f1399529cca63655457/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.775373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3a1791b2fb47b1b9c0d50312d822bc, user_id=52e8384a41584f1399529cca63655457, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.788448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.807076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 859/1736] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:21.810512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.851233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 878/1737] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:21 2022] PUT /identity/v3/projects/dc3a1791b2fb47b1b9c0d50312d822bc/users/52e8384a41584f1399529cca63655457/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:21.851233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.970076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811d39f-9efb-441b-8c6c-d003e26935e3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.984653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.985373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.985665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.986134 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.994576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:22.046300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2ef12-6df5-448f-a3d2-38539d46e9d4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.177605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:22.190139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.193474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.214972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 860/1738] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:22.216654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.246543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ca91-31aa-40d1-a606-d0008e88e461 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.251216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.256912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.257512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.257812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.260089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.264844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.267976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.268275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.268562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.271191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.273702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:22.346362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 879/1739] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/users => generated 287 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:22.347589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.382350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5849b5-53ba-4842-9f7b-1d90ae63e422 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.400755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.401752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.404793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.405121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.408134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.417959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.469323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 880/1740] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:22.475342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.499703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.502843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.519228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 861/1741] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:22.523379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8504d-acaa-4a68-bfe0-adb29ba93369 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.529832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980e528-d551-4eb7-b10a-f18d9dc4f801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.530824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e528-d551-4eb7-b10a-f18d9dc4f801 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.531243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e528-d551-4eb7-b10a-f18d9dc4f801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.531665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e528-d551-4eb7-b10a-f18d9dc4f801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.533770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980e528-d551-4eb7-b10a-f18d9dc4f801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.535212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980e528-d551-4eb7-b10a-f18d9dc4f801 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.560869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.568654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 881/1742] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:22.578035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e73d9d-aab1-4f59-bf62-2183be9d53c2 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.588804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.593127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.593684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.594164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] PATH_INFO: `/v3/projects/c57fc4e8f45d4cdfbdab0766c5645871/users/967a6364a7c04eaf8896d8f6d13c08a4/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.676254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57fc4e8f45d4cdfbdab0766c5645871, user_id=967a6364a7c04eaf8896d8f6d13c08a4, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.683037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.733223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf8e0-cb52-4a2a-a937-863fe822f24f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.733935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf8e0-cb52-4a2a-a937-863fe822f24f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.733935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf8e0-cb52-4a2a-a937-863fe822f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.740525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 862/1743] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:22 2022] PUT /identity/v3/projects/c57fc4e8f45d4cdfbdab0766c5645871/users/967a6364a7c04eaf8896d8f6d13c08a4/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:22.820712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-faccf8e0-cb52-4a2a-a937-863fe822f24f None None] MFA Rules not processed for user `967a6364a7c04eaf8896d8f6d13c08a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:22.826616 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-faccf8e0-cb52-4a2a-a937-863fe822f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.006380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:23.066000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 882/1744] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:23.068195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.234361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982972f-482f-4dac-9be2-24aa5000da73 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.246421 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.247290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.247579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.247865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.248578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.254582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.318512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 863/1745] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:23 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:23.322501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccf8e0-cb52-4a2a-a937-863fe822f24f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.340566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccf8e0-cb52-4a2a-a937-863fe822f24f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.507333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.510819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.511111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.513496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.514818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.531064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.580577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 883/1746] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:23 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:23.585415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.610543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfda68-86c3-4dca-9afa-4279c424691d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.636135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.648746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.649207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.649450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.656455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.660092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.717598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 864/1747] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:23.721737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.737422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb7d57-18f0-4b7d-8e8c-fbf7358d7d73 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.774095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.777093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.777971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.778286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] PATH_INFO: `/v3/projects/a2684d58d6f3481ea2f15665f688e952/users/4a665b67b643455b8d6c3ab8fa236276/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.877841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2684d58d6f3481ea2f15665f688e952, user_id=4a665b67b643455b8d6c3ab8fa236276, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.890394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.948322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 884/1748] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:23 2022] PUT /identity/v3/projects/a2684d58d6f3481ea2f15665f688e952/users/4a665b67b643455b8d6c3ab8fa236276/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:23.952211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.975610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8c25-fad5-4955-8812-95e66fdafaed admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.163056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:24.217639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c64168-3dec-41ef-828e-873c38f848a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.218355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c64168-3dec-41ef-828e-873c38f848a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.218643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c64168-3dec-41ef-828e-873c38f848a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.218930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c64168-3dec-41ef-828e-873c38f848a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.219939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c64168-3dec-41ef-828e-873c38f848a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.221656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c64168-3dec-41ef-828e-873c38f848a4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:24.271147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:24.273556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 865/1749] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:24.291614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f045600-5273-449e-a2fe-042f6d2cf67c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.305335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.308211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.309459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.309975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] PATH_INFO: `/v3/projects/a2684d58d6f3481ea2f15665f688e952/users/4a665b67b643455b8d6c3ab8fa236276/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.316549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2684d58d6f3481ea2f15665f688e952, user_id=4a665b67b643455b8d6c3ab8fa236276, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.324482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:24.350006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 885/1750] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:24 2022] PUT /identity/v3/projects/a2684d58d6f3481ea2f15665f688e952/users/4a665b67b643455b8d6c3ab8fa236276/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:24.362305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb258c-cafc-44c0-ad30-62f0189e4b14 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.362627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb258c-cafc-44c0-ad30-62f0189e4b14 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.362930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb258c-cafc-44c0-ad30-62f0189e4b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.430151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-88bb258c-cafc-44c0-ad30-62f0189e4b14 None None] MFA Rules not processed for user `4a665b67b643455b8d6c3ab8fa236276`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:24.431420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-88bb258c-cafc-44c0-ad30-62f0189e4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:24.695172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 866/1751] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:24.703739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:24.884721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e2e2c-2aff-479e-86fb-f188d0d5d278 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.901364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba6a09-4a20-4b93-9b3b-4504498fe384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.902044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6a09-4a20-4b93-9b3b-4504498fe384 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.902330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6a09-4a20-4b93-9b3b-4504498fe384 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.902615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6a09-4a20-4b93-9b3b-4504498fe384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.940323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba6a09-4a20-4b93-9b3b-4504498fe384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.946773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba6a09-4a20-4b93-9b3b-4504498fe384 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:24.986305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 886/1752] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:25.001686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.002159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.002587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.061431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] MFA Rules not processed for user `1e4883f7b657491189ac4012d1bee604`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:25.063683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:25.279892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 867/1753] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:25.291975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5886e9e-0b7a-4bc6-8098-3b4bea624965 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.292276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5886e9e-0b7a-4bc6-8098-3b4bea624965 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.293022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5886e9e-0b7a-4bc6-8098-3b4bea624965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.334073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d5886e9e-0b7a-4bc6-8098-3b4bea624965 None None] MFA Rules not processed for user `1e4883f7b657491189ac4012d1bee604`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:25.335601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d5886e9e-0b7a-4bc6-8098-3b4bea624965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:25.363259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 887/1754] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:25.371641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.373886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:25.498157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:25.569526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae1bce-1af5-4384-96de-6b5a48fa6557 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.581545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.582768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.583052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.583330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.588645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.589914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.590733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.602116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.609957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.661652 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 868/1755] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:25.730494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:25.783771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:25.789590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.148887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 888/1756] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:26.402691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:26.537222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:26.538776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.659192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c40f1-5789-42f5-bc90-1478482da980 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:26.684311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:26.691386 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.691797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.692901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] PATH_INFO: `/v3/users/967a6364a7c04eaf8896d8f6d13c08a4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:26.694825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=967a6364a7c04eaf8896d8f6d13c08a4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:26.703991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:26.842708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83de87-86a3-4952-b4db-64285c5c146d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:26.859508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af92e8a-99e4-47d4-8793-653a0497c01e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:26.861126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92e8a-99e4-47d4-8793-653a0497c01e service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.868611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92e8a-99e4-47d4-8793-653a0497c01e service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.869277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92e8a-99e4-47d4-8793-653a0497c01e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:26.893598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af92e8a-99e4-47d4-8793-653a0497c01e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:26.898848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af92e8a-99e4-47d4-8793-653a0497c01e service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:26.925431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 889/1757] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:18:26.945567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967a6364a7c04eaf8896d8f6d13c08a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:26.989382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967a6364a7c04eaf8896d8f6d13c08a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:26.990154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967a6364a7c04eaf8896d8f6d13c08a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.015107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967a6364a7c04eaf8896d8f6d13c08a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.053589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f60de10e-d838-4392-9554-aaeafe2ed5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967a6364a7c04eaf8896d8f6d13c08a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.075746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 869/1758] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:26 2022] DELETE /identity/v3/users/967a6364a7c04eaf8896d8f6d13c08a4 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:27.079524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.080217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.080616 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.114505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:27.119053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.200137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.201233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.201958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.268195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] MFA Rules not processed for user `52e8384a41584f1399529cca63655457`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:27.270634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.323018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 890/1759] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:27.391399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:27.466331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 870/1760] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:28.154517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.156512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.203933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:28.366838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10463e14-4709-4631-a726-ebd261b6f9f4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:28.385359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9e808-05a5-403c-a08a-a541a2b7bd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:28.386518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e808-05a5-403c-a08a-a541a2b7bd5f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.387034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e808-05a5-403c-a08a-a541a2b7bd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.387542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e808-05a5-403c-a08a-a541a2b7bd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.414341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9e808-05a5-403c-a08a-a541a2b7bd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:28.416193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9e808-05a5-403c-a08a-a541a2b7bd5f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:28.464391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 891/1761] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:29.210080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.211692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.233758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90eed8-9163-472d-8f21-0b027dd63749 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.247552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.248932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.249459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.249960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] PATH_INFO: `/v3/users/0213340a4b23415fa27a8134f4ea50df` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.257148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0213340a4b23415fa27a8134f4ea50df)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.260967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.362332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0213340a4b23415fa27a8134f4ea50df'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:29.398697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0213340a4b23415fa27a8134f4ea50df'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:29.400720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0213340a4b23415fa27a8134f4ea50df'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:29.429763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0213340a4b23415fa27a8134f4ea50df'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:29.438560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0213340a4b23415fa27a8134f4ea50df'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:29.460980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 871/1762] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:29 2022] DELETE /identity/v3/users/0213340a4b23415fa27a8134f4ea50df => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:29.465535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870adf8-dbe5-4146-a238-4183c8d9ee98 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.466041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870adf8-dbe5-4146-a238-4183c8d9ee98 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.466124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870adf8-dbe5-4146-a238-4183c8d9ee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.511423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2870adf8-dbe5-4146-a238-4183c8d9ee98 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:29.513630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2870adf8-dbe5-4146-a238-4183c8d9ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.658552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 892/1763] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:29.700278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.702132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.921547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707117-af68-4c8e-aed4-288376ecdbba admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.930935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.932404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.934502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.935096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.947487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.952432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.969865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 872/1764] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:30.512935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fd57b-b48f-4a0b-8256-45d7ad93324f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.513819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fd57b-b48f-4a0b-8256-45d7ad93324f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.514322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fd57b-b48f-4a0b-8256-45d7ad93324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.567588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f01fd57b-b48f-4a0b-8256-45d7ad93324f None None] MFA Rules not processed for user `50d222dc33d04421a9cdb1672aaacbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:30.570678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f01fd57b-b48f-4a0b-8256-45d7ad93324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:30.735825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 893/1765] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:30.741944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:30.745018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:30.798379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d58b-1117-416c-a3f7-65dba8593852 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.798890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d58b-1117-416c-a3f7-65dba8593852 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.799319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d58b-1117-416c-a3f7-65dba8593852 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.803361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 894/1766] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:18:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:30.817533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.818152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.818455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.857758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:30.864195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:30.868706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:30.896661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8c0e7-e6b0-406b-b439-fa24f207ccd5 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:30.916055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:30.917059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.918071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.918796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.943019 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:30.947450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:30.981263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 873/1767] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:30.996441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:31.039547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 895/1768] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:31.067309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.070706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.103691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8460c6c-9048-4290-92f1-fa1807b4a6d9 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.110399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6fa3d-99b9-4d42-b59a-effbd01cc1a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.111162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6fa3d-99b9-4d42-b59a-effbd01cc1a4 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.111592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6fa3d-99b9-4d42-b59a-effbd01cc1a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.111947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6fa3d-99b9-4d42-b59a-effbd01cc1a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.125069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6fa3d-99b9-4d42-b59a-effbd01cc1a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.127728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6fa3d-99b9-4d42-b59a-effbd01cc1a4 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.159912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 874/1769] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:31.202395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.203856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.237802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba477fd-d293-4d9a-a8e2-6f95ce52b479 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.282746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.286711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.288160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.290149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] PATH_INFO: `/v3/projects/c57fc4e8f45d4cdfbdab0766c5645871` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.293736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57fc4e8f45d4cdfbdab0766c5645871)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.302243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.484566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57fc4e8f45d4cdfbdab0766c5645871', 'request_id': 'req-fca8000c-2416-4f8f-b69b-0959ebd16863'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.485444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636330e3-312b-420b-ba54-d1e9d729171f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.486211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636330e3-312b-420b-ba54-d1e9d729171f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.486971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636330e3-312b-420b-ba54-d1e9d729171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.505590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57fc4e8f45d4cdfbdab0766c5645871', 'request_id': 'req-fca8000c-2416-4f8f-b69b-0959ebd16863'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.512633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57fc4e8f45d4cdfbdab0766c5645871', 'request_id': 'req-fca8000c-2416-4f8f-b69b-0959ebd16863'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.538447 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] The token cache is being invalidate because project c57fc4e8f45d4cdfbdab0766c5645871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:31.539110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.539568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.541579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 896/1770] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:31 2022] DELETE /identity/v3/projects/c57fc4e8f45d4cdfbdab0766c5645871 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:31.546547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.548330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.601116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-636330e3-312b-420b-ba54-d1e9d729171f None None] MFA Rules not processed for user `7b1d74995a6b407698b38e4b74e53556`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:31.603162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-636330e3-312b-420b-ba54-d1e9d729171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.691627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8000c-2416-4f8f-b69b-0959ebd16863 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.697189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.698088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.698370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.698646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] PATH_INFO: `/v3/users/4a665b67b643455b8d6c3ab8fa236276` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.709008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a665b67b643455b8d6c3ab8fa236276)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.710997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.812521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a665b67b643455b8d6c3ab8fa236276'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.847006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a665b67b643455b8d6c3ab8fa236276'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.855545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:31.864102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a665b67b643455b8d6c3ab8fa236276'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.880958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a665b67b643455b8d6c3ab8fa236276'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.881992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a665b67b643455b8d6c3ab8fa236276'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.894509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 897/1771] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:31 2022] DELETE /identity/v3/users/4a665b67b643455b8d6c3ab8fa236276 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:31.896884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.902322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.036028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 875/1772] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:32.036028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.036028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.036028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.093562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:32.101874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.213317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8973-2d8a-4652-b066-d041528e9ab9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:32.257761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:32.258675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.258958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.259311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] PATH_INFO: `/v3/projects/e0eb634741cc4308a990a252aa56f8c7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.270589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0eb634741cc4308a990a252aa56f8c7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:32.272691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:32.307427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 876/1773] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jul 21 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:32.313297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:32.322084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.448639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0eb634741cc4308a990a252aa56f8c7', 'request_id': 'req-f2662f90-6eae-40fb-9d1f-ed24043d0a03'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.469456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0eb634741cc4308a990a252aa56f8c7', 'request_id': 'req-f2662f90-6eae-40fb-9d1f-ed24043d0a03'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.495336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0eb634741cc4308a990a252aa56f8c7', 'request_id': 'req-f2662f90-6eae-40fb-9d1f-ed24043d0a03'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.526333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] The token cache is being invalidate because project e0eb634741cc4308a990a252aa56f8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:32.526630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.531211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.539431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 898/1774] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:31 2022] DELETE /identity/v3/projects/e0eb634741cc4308a990a252aa56f8c7 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:32.545488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:32.551295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.609688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92d41e-c86a-4305-8157-7713205ec97e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:32.617974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:32.810708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:32.812026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.813126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.813871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.818991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.907271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2662f90-6eae-40fb-9d1f-ed24043d0a03 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:32.917523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:32.919597 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.919858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.920155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] PATH_INFO: `/v3/users/fde7e1404c004ec3af67dc425a807632` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.925062 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde7e1404c004ec3af67dc425a807632)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:32.928755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:32.959285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:33.089338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde7e1404c004ec3af67dc425a807632'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.092984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:33.100742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:33.153005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde7e1404c004ec3af67dc425a807632'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.153994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 877/1775] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:33.155197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:33.161414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:33.172506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde7e1404c004ec3af67dc425a807632'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.202343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde7e1404c004ec3af67dc425a807632'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.206331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde7e1404c004ec3af67dc425a807632'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.235503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 899/1776] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:32 2022] DELETE /identity/v3/users/fde7e1404c004ec3af67dc425a807632 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:33.358380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e816c0e-a16e-4588-a398-7ebb5efe1477 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:33.453481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:33.454971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:33.640630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5efc9-8840-4b88-bb0c-a44cd0ebf41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:33.641335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5efc9-8840-4b88-bb0c-a44cd0ebf41f service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.641628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5efc9-8840-4b88-bb0c-a44cd0ebf41f service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.641914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5efc9-8840-4b88-bb0c-a44cd0ebf41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.654882 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-52a5efc9-8840-4b88-bb0c-a44cd0ebf41f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:33.696814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5efc9-8840-4b88-bb0c-a44cd0ebf41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:33.703012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5efc9-8840-4b88-bb0c-a44cd0ebf41f service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:33.754653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 878/1777] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:33.762185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6a3e-2242-4663-9dfc-636d37d0f856 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:33.777676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:33.779452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.781921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.784163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] PATH_INFO: `/v3/projects/a2684d58d6f3481ea2f15665f688e952` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.788123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2684d58d6f3481ea2f15665f688e952)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:33.797687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:33.923347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2684d58d6f3481ea2f15665f688e952', 'request_id': 'req-feba5f48-8409-4d02-9d96-a94a8982f8b5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.941970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2684d58d6f3481ea2f15665f688e952', 'request_id': 'req-feba5f48-8409-4d02-9d96-a94a8982f8b5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.954904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2684d58d6f3481ea2f15665f688e952', 'request_id': 'req-feba5f48-8409-4d02-9d96-a94a8982f8b5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.979648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] The token cache is being invalidate because project a2684d58d6f3481ea2f15665f688e952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:33.980183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.981016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-feba5f48-8409-4d02-9d96-a94a8982f8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:33.986552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 900/1778] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:33 2022] DELETE /identity/v3/projects/a2684d58d6f3481ea2f15665f688e952 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:33.990103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6115-a3ce-4609-9c5b-749d1c24b27c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.990528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6115-a3ce-4609-9c5b-749d1c24b27c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.990837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6115-a3ce-4609-9c5b-749d1c24b27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.005387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:34.030056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-08bb6115-a3ce-4609-9c5b-749d1c24b27c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:34.031337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-08bb6115-a3ce-4609-9c5b-749d1c24b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.234954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 879/1779] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:34.248077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65872d-b891-43e7-8e25-1de913486b7b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.248077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65872d-b891-43e7-8e25-1de913486b7b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.248077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65872d-b891-43e7-8e25-1de913486b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.295886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4c65872d-b891-43e7-8e25-1de913486b7b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:34.301276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4c65872d-b891-43e7-8e25-1de913486b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.361838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 901/1780] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:34.366334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6115-a3ce-4609-9c5b-749d1c24b27c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.388639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6115-a3ce-4609-9c5b-749d1c24b27c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.414669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.415577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.415853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.416189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.417787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:34.417999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.420856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.436269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 880/1781] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:34.440864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65872d-b891-43e7-8e25-1de913486b7b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.454881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65872d-b891-43e7-8e25-1de913486b7b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.473775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.474525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.482020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.482391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.483165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.490602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.576486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:34.631818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 902/1782] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:34 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:34.633186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.662269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5d56-7ebc-4920-acf3-b0865f68da86 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.935948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.945291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.945587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.945877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.948780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.957677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.025716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 881/1783] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:34 2022] POST /identity/v3/users => generated 297 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:35.032450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.067549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc15b9-5c9a-4a9d-8aee-06603c16559b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.086804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.089577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.089872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.090161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.090927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.099560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.142830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 903/1784] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:35.147339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.165729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c660d7c-cde0-436f-ae7f-8379a9aa6b25 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.188533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af85015-8f71-4a7e-a7ef-dec02be97034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.189424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85015-8f71-4a7e-a7ef-dec02be97034 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.196461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85015-8f71-4a7e-a7ef-dec02be97034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.196925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85015-8f71-4a7e-a7ef-dec02be97034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.201560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af85015-8f71-4a7e-a7ef-dec02be97034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.203980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af85015-8f71-4a7e-a7ef-dec02be97034 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.248904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 882/1785] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:35.253396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.273104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a04c8-3480-4a65-889b-95edafe6e613 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.290715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.292989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.293319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.293591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] PATH_INFO: `/v3/projects/908ac9d63c7c4ab3b00f8e46413aa19e/users/d54fa52968aa41b4adb46020d9ae9518/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.359565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908ac9d63c7c4ab3b00f8e46413aa19e, user_id=d54fa52968aa41b4adb46020d9ae9518, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.371297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.404569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 904/1786] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:35 2022] PUT /identity/v3/projects/908ac9d63c7c4ab3b00f8e46413aa19e/users/d54fa52968aa41b4adb46020d9ae9518/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:35.406616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56ca67-e15c-4984-9175-f2147149770d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.407019 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56ca67-e15c-4984-9175-f2147149770d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.407446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56ca67-e15c-4984-9175-f2147149770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.519016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ff56ca67-e15c-4984-9175-f2147149770d None None] MFA Rules not processed for user `d54fa52968aa41b4adb46020d9ae9518`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:35.521969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ff56ca67-e15c-4984-9175-f2147149770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:35.650406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:35.672545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 883/1787] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:35.678152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.843615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc350ed7-35f7-4f95-98f0-10d9720c03f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.863881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.864806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.865126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.865411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.866267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.870764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.966154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 905/1788] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:35 2022] POST /identity/v3/projects => generated 391 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:35.966354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56ca67-e15c-4984-9175-f2147149770d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.980764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56ca67-e15c-4984-9175-f2147149770d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.188458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcd02b-ccd7-4859-8264-2a3d1f9640b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.189241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcd02b-ccd7-4859-8264-2a3d1f9640b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.189537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcd02b-ccd7-4859-8264-2a3d1f9640b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.189828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcd02b-ccd7-4859-8264-2a3d1f9640b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.192630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcd02b-ccd7-4859-8264-2a3d1f9640b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.194702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcd02b-ccd7-4859-8264-2a3d1f9640b3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.257114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 884/1789] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:35 2022] POST /identity/v3/users => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:36.258241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.259747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d9d29-ba2d-4dd8-84b0-a53b1f9d7831 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.260053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d9d29-ba2d-4dd8-84b0-a53b1f9d7831 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.260396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d9d29-ba2d-4dd8-84b0-a53b1f9d7831 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.264994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 885/1790] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:18:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:36.287251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef097-c68b-4d07-ad2f-25d17fb12729 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.299006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d9d29-ba2d-4dd8-84b0-a53b1f9d7831 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.301977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ba1d9d29-ba2d-4dd8-84b0-a53b1f9d7831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:36.326635 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.327404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.327727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.328016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.331698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.333606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.391854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d9d29-ba2d-4dd8-84b0-a53b1f9d7831 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.403073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 906/1791] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:36.404230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.406138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.411994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.412205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.413599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] PATH_INFO: `/v3/users/1b7dcbb86eaf4388a343cc25771ba164` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.418336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7dcbb86eaf4388a343cc25771ba164)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.424329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.441858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd2c68-fb20-4ef2-a0f8-ff06685dd85e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.481331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83ec78-d44d-42f8-a72e-ee859394ac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.482315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83ec78-d44d-42f8-a72e-ee859394ac48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.482660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83ec78-d44d-42f8-a72e-ee859394ac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.483590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83ec78-d44d-42f8-a72e-ee859394ac48 admin admin] PATH_INFO: `/v3/projects/77ef749aa70f4e1c9a3892071ee23b25/users/b03d42759b354c32b917b4254f0741e9/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.533801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83ec78-d44d-42f8-a72e-ee859394ac48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ef749aa70f4e1c9a3892071ee23b25, user_id=b03d42759b354c32b917b4254f0741e9, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.545506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83ec78-d44d-42f8-a72e-ee859394ac48 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.546337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7dcbb86eaf4388a343cc25771ba164'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:36.562146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7dcbb86eaf4388a343cc25771ba164'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:36.566315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7dcbb86eaf4388a343cc25771ba164'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:36.574839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 907/1792] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:36 2022] PUT /identity/v3/projects/77ef749aa70f4e1c9a3892071ee23b25/users/b03d42759b354c32b917b4254f0741e9/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:36.577736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa00f2-08c9-4c95-b22c-b15caa420945 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.577736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa00f2-08c9-4c95-b22c-b15caa420945 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.577736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa00f2-08c9-4c95-b22c-b15caa420945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.582753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7dcbb86eaf4388a343cc25771ba164'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:36.601418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7dcbb86eaf4388a343cc25771ba164'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:36.616327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 886/1793] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:36 2022] DELETE /identity/v3/users/1b7dcbb86eaf4388a343cc25771ba164 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:36.616327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.616327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:36.621887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9faa00f2-08c9-4c95-b22c-b15caa420945 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:36.623680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9faa00f2-08c9-4c95-b22c-b15caa420945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:36.786327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2144ab-d5a2-4bff-923e-22531cf522f3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.808746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.809113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.809373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.809659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.810661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.812049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.813840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:36.851782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 887/1794] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:36.852663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.887271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039e39-a8af-4b2a-8116-95f5a3e21f45 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.900522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.901473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.901789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.902034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] PATH_INFO: `/v3/projects/77ef749aa70f4e1c9a3892071ee23b25/users/b03d42759b354c32b917b4254f0741e9/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.914806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ef749aa70f4e1c9a3892071ee23b25, user_id=b03d42759b354c32b917b4254f0741e9, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.917912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.930592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 908/1795] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:36.955874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 888/1796] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:36 2022] PUT /identity/v3/projects/77ef749aa70f4e1c9a3892071ee23b25/users/b03d42759b354c32b917b4254f0741e9/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:36.961169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.961169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.961169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.999178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:37.061098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] MFA Rules not processed for user `b03d42759b354c32b917b4254f0741e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:37.062826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:37.124336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.126424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:37.374707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 909/1797] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:37.391599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f5a46-a49e-4a30-9e40-6588c9e1ea4d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.392683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.394676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:37.416169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.419633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.426489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.427075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.451938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.459240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.505122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 889/1798] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:37.507952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.511117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:37.573848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7173043-ee3d-4df2-9d21-bdb83ca3372d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.595569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.598475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.602958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.603286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.642889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.644599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.678640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 910/1799] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:37.679567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.694044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:37.699356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d93778-07c8-4d46-bcb3-824f2e085baa service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.720323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22399ba4-b388-47f6-8c98-1aae02a8d089 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.723920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.729096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.730811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.731334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] PATH_INFO: `/v3/users/5ab0b8974bc04185b6b4679a576cffc4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.736590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab0b8974bc04185b6b4679a576cffc4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.745544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.747298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.748183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.748462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.748739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] PATH_INFO: `/v3/projects/b7af952df0f34b7cb71d37ac52c2af4e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.750195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7af952df0f34b7cb71d37ac52c2af4e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.752735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.871796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab0b8974bc04185b6b4679a576cffc4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:37.958066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab0b8974bc04185b6b4679a576cffc4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:37.959176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab0b8974bc04185b6b4679a576cffc4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:37.970415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7af952df0f34b7cb71d37ac52c2af4e', 'request_id': 'req-48aa3b18-964d-411f-b95a-d0de47e7300e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:37.978054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab0b8974bc04185b6b4679a576cffc4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:37.982876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:37.998638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7af952df0f34b7cb71d37ac52c2af4e', 'request_id': 'req-48aa3b18-964d-411f-b95a-d0de47e7300e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.000506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab0b8974bc04185b6b4679a576cffc4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.018599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 890/1800] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:37 2022] DELETE /identity/v3/users/5ab0b8974bc04185b6b4679a576cffc4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:38.020600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.030018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.084996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7af952df0f34b7cb71d37ac52c2af4e', 'request_id': 'req-48aa3b18-964d-411f-b95a-d0de47e7300e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.133174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] The token cache is being invalidate because project b7af952df0f34b7cb71d37ac52c2af4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:38.133542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.137298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-48aa3b18-964d-411f-b95a-d0de47e7300e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.139924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 911/1801] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:37 2022] DELETE /identity/v3/projects/b7af952df0f34b7cb71d37ac52c2af4e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:38.142626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898c50-a215-4a1f-b90b-619566042d93 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.145954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898c50-a215-4a1f-b90b-619566042d93 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.146399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898c50-a215-4a1f-b90b-619566042d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.214888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-82898c50-a215-4a1f-b90b-619566042d93 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:38.217442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393347a1-cd61-44a3-a09b-463938564af6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:38.217663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82898c50-a215-4a1f-b90b-619566042d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.229532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:38.230191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.230475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.230752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.237259 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.254808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:38.316140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 912/1802] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:38.321689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57c4dd-0dc8-4ec4-8d31-005f73b6b62b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.321993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57c4dd-0dc8-4ec4-8d31-005f73b6b62b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.322284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57c4dd-0dc8-4ec4-8d31-005f73b6b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.365527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9a57c4dd-0dc8-4ec4-8d31-005f73b6b62b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:38.367047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9a57c4dd-0dc8-4ec4-8d31-005f73b6b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.383501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.385298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.387266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 913/1803] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:38.398298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.398594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.398881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.405608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 891/1804] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:38.477930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:38.479182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.513357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 914/1805] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:38.517820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.539519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6826e2-68c5-4b69-b295-5e6c97f47a12 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:38.561484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:38.562308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.562651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.570099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.585951 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:38.586338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.600809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.601396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.602965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.670828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 892/1806] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:38.673885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.704682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9747b6-af63-4915-8ff0-01c18b6907b6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:38.726126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:38.726806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.727091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.727487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.728228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.730454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.845523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 893/1807] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:38 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:38.847843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.927323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce8097-f4fe-43ed-9a27-1d622091f807 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.037113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab61e7-6d0a-4cc4-9668-e28b6b94a5cd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.047762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.048500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.048787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.049090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.049800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.052374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.082327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:39.095717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 894/1808] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:38 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:39.097641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.128010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8194c0-0038-4916-9dd9-e346193054b5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.136617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.137351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.137635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.137917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.138657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.140294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.169539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 895/1809] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:39.173613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.195972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b6bde-b1da-4d9d-a9cd-6639543dbc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.196665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b6bde-b1da-4d9d-a9cd-6639543dbc03 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.198195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b6bde-b1da-4d9d-a9cd-6639543dbc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.198382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39260c0-d524-4dfe-80fc-d8b697f4f15d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.198498 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b6bde-b1da-4d9d-a9cd-6639543dbc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.210935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.211717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.212005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.212289 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.213057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.214733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.228187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b6bde-b1da-4d9d-a9cd-6639543dbc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.229696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b6bde-b1da-4d9d-a9cd-6639543dbc03 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.247408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 896/1810] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:39.255023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.263487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 915/1811] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:39.274698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2fd20-860e-4937-a19f-b9dbee320c5d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.297807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.298743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.299029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.299319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] PATH_INFO: `/v3/projects/4cc7956b9a9a4986bc0f9a28dc2ec944/users/fca34485b72c48f2ad960736c596eed3/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.339526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc7956b9a9a4986bc0f9a28dc2ec944, user_id=fca34485b72c48f2ad960736c596eed3, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.342332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.373935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 897/1812] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:39 2022] PUT /identity/v3/projects/4cc7956b9a9a4986bc0f9a28dc2ec944/users/fca34485b72c48f2ad960736c596eed3/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:39.381324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7ff9b-fd23-491c-9215-fc476a204f6f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.381656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7ff9b-fd23-491c-9215-fc476a204f6f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.381849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7ff9b-fd23-491c-9215-fc476a204f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.432363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3ea7ff9b-fd23-491c-9215-fc476a204f6f None None] MFA Rules not processed for user `fca34485b72c48f2ad960736c596eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:39.434436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ea7ff9b-fd23-491c-9215-fc476a204f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.499971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.503046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.633013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:39.667883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 916/1813] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:39.674756 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7ff9b-fd23-491c-9215-fc476a204f6f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.707675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d252ba-d827-4fda-9590-3e12e5add1ed admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.721419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.724800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.726141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.726959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] PATH_INFO: `/v3/projects/03712862689a45c7a3b6e2ea32c71946` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.731164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=03712862689a45c7a3b6e2ea32c71946)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.736639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.871309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03712862689a45c7a3b6e2ea32c71946', 'request_id': 'req-838d9df2-f178-4fd0-b3ed-d3d3927255ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:39.876290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7ff9b-fd23-491c-9215-fc476a204f6f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.900348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03712862689a45c7a3b6e2ea32c71946', 'request_id': 'req-838d9df2-f178-4fd0-b3ed-d3d3927255ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:39.925681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03712862689a45c7a3b6e2ea32c71946', 'request_id': 'req-838d9df2-f178-4fd0-b3ed-d3d3927255ae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:39.957822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] The token cache is being invalidate because project 03712862689a45c7a3b6e2ea32c71946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:39.958311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:39.958918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:39.961686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 898/1814] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:39 2022] DELETE /identity/v3/projects/03712862689a45c7a3b6e2ea32c71946 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:39.966108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.968423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:40.067168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:40.067970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:40.068263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:40.068618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:40.069781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:40.090783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:40.094003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:40.138265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9df2-f178-4fd0-b3ed-d3d3927255ae admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:40.146697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:40.147886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:40.148172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:40.148453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] PATH_INFO: `/v3/users/52e8384a41584f1399529cca63655457` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:40.149783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e8384a41584f1399529cca63655457)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:40.151805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 917/1815] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:39 2022] POST /identity/v3/projects => generated 387 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:40.151935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:40.153668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:40.157388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:40.243673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e8384a41584f1399529cca63655457'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.270516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e8384a41584f1399529cca63655457'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.271924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e8384a41584f1399529cca63655457'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.288426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e8384a41584f1399529cca63655457'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.301973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e8384a41584f1399529cca63655457'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.309758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 899/1816] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:39 2022] DELETE /identity/v3/users/52e8384a41584f1399529cca63655457 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:40.517159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9957e2-642b-4358-b70d-dda2a85840f3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:40.690359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:40.780468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:40.781781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:40.782366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:40.782570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:40.783524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:40.786483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:40.841401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 918/1817] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:40 2022] POST /identity/v3/users => generated 300 bytes in 686 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:40.842748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:40.844498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:40.875126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90920f86-f6cb-4001-b5f2-4c61f4d91e03 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:40.885204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:40.886003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:40.886299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:40.886979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:40.888493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:40.899384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:40.962903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 900/1818] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:40.967943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:40.993227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72a540-d9b4-47a1-8912-c4963bb67828 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:41.010021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:41.010960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.011302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.012052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] PATH_INFO: `/v3/projects/2af2e030b78645cfbedbcb3f1a8c86ab/users/e72678b28777420b9c96f9fafa04526d/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.062307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af2e030b78645cfbedbcb3f1a8c86ab, user_id=e72678b28777420b9c96f9fafa04526d, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:41.066989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:41.096023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 919/1819] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:40 2022] PUT /identity/v3/projects/2af2e030b78645cfbedbcb3f1a8c86ab/users/e72678b28777420b9c96f9fafa04526d/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:41.102119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:41.162487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da4781-b8bb-419c-8c34-bdef70ef2f47 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:41.309422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:41.312014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:41.341323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:41.342245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.355099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.355463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.356266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:41.357969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:41.386445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 901/1820] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:41.390935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:41.404934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5922-3281-4a64-908c-046d805b1b1a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:41.415643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548cc9f-ffdc-48d0-9c1a-59ae642b707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:41.416595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cc9f-ffdc-48d0-9c1a-59ae642b707c admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.420449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cc9f-ffdc-48d0-9c1a-59ae642b707c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.420740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cc9f-ffdc-48d0-9c1a-59ae642b707c admin admin] PATH_INFO: `/v3/projects/2af2e030b78645cfbedbcb3f1a8c86ab/users/e72678b28777420b9c96f9fafa04526d/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.428885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548cc9f-ffdc-48d0-9c1a-59ae642b707c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af2e030b78645cfbedbcb3f1a8c86ab, user_id=e72678b28777420b9c96f9fafa04526d, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:41.439809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548cc9f-ffdc-48d0-9c1a-59ae642b707c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:41.510692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 902/1821] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:41 2022] PUT /identity/v3/projects/2af2e030b78645cfbedbcb3f1a8c86ab/users/e72678b28777420b9c96f9fafa04526d/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:41.522235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feef4f-96ac-42f9-8180-65464ba67bf9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.522919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feef4f-96ac-42f9-8180-65464ba67bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.523364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feef4f-96ac-42f9-8180-65464ba67bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.564870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcb620-63e2-4aee-ad01-3645fc3018fd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:41.593915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-53feef4f-96ac-42f9-8180-65464ba67bf9 None None] MFA Rules not processed for user `e72678b28777420b9c96f9fafa04526d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:41.595202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-53feef4f-96ac-42f9-8180-65464ba67bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:41.661345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:41.749405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 903/1822] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:41.750923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.753079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.754056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.810065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:41.811060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.811345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.811633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] PATH_INFO: `/v3/projects/a4304172cc9d41a88a8c42e9e5bf3930` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.813783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4304172cc9d41a88a8c42e9e5bf3930)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:41.815520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:41.815659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] MFA Rules not processed for user `50d222dc33d04421a9cdb1672aaacbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:41.818338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:41.983659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 904/1823] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:41.986881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:41.991053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:42.013773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:42.029475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4304172cc9d41a88a8c42e9e5bf3930', 'request_id': 'req-600cbed1-67f3-4faf-b445-2c168a41a2f8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.055964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4304172cc9d41a88a8c42e9e5bf3930', 'request_id': 'req-600cbed1-67f3-4faf-b445-2c168a41a2f8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.085824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4304172cc9d41a88a8c42e9e5bf3930', 'request_id': 'req-600cbed1-67f3-4faf-b445-2c168a41a2f8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.147746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] The token cache is being invalidate because project a4304172cc9d41a88a8c42e9e5bf3930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:42.149274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.152713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.162317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 920/1824] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:41 2022] DELETE /identity/v3/projects/a4304172cc9d41a88a8c42e9e5bf3930 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:42.163698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:42.165345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:42.211883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69229aa1-1c36-4a64-89ab-881182b3adb8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:42.391749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cbed1-67f3-4faf-b445-2c168a41a2f8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:42.411396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:42.412469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:42.412902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:42.413297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] PATH_INFO: `/v3/users/b1ecabd77bb343d6b8906678b5911de7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:42.415791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ecabd77bb343d6b8906678b5911de7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:42.420210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:42.426539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d20d8-8e32-4e23-b23d-5a96af54365e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:42.427682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d20d8-8e32-4e23-b23d-5a96af54365e service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:42.428862 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d20d8-8e32-4e23-b23d-5a96af54365e service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:42.429541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d20d8-8e32-4e23-b23d-5a96af54365e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:42.433147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-af6d20d8-8e32-4e23-b23d-5a96af54365e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:42.526462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:42.586788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ecabd77bb343d6b8906678b5911de7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.687896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ecabd77bb343d6b8906678b5911de7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.711954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ecabd77bb343d6b8906678b5911de7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.725116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d20d8-8e32-4e23-b23d-5a96af54365e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:42.727241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d20d8-8e32-4e23-b23d-5a96af54365e service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:42.741119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ecabd77bb343d6b8906678b5911de7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.746589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ecabd77bb343d6b8906678b5911de7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:42.758852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 921/1825] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:42 2022] DELETE /identity/v3/users/b1ecabd77bb343d6b8906678b5911de7 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:42.762558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 905/1826] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:42.898935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:42.901132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:42.952411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee25e5-ed6e-41f3-921d-7130f0b0e5fc None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:42.952861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee25e5-ed6e-41f3-921d-7130f0b0e5fc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:42.953797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee25e5-ed6e-41f3-921d-7130f0b0e5fc None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:42.954887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 906/1827] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:18:42.967223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7ae0-db43-43a1-9c93-fdd9ba855527 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:42.967646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7ae0-db43-43a1-9c93-fdd9ba855527 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:42.968032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7ae0-db43-43a1-9c93-fdd9ba855527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.020637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-689f7ae0-db43-43a1-9c93-fdd9ba855527 None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:43.028543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-689f7ae0-db43-43a1-9c93-fdd9ba855527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:43.126353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:43.154808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328df58-f791-40a5-a774-dee9c45965d2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:43.172172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:43.176562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.178385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:43.179573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] PATH_INFO: `/v3/users/fca34485b72c48f2ad960736c596eed3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.207970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca34485b72c48f2ad960736c596eed3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:43.227187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:43.277496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 907/1828] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:43.466302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca34485b72c48f2ad960736c596eed3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.571984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca34485b72c48f2ad960736c596eed3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.585624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca34485b72c48f2ad960736c596eed3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.598514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca34485b72c48f2ad960736c596eed3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.600166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca34485b72c48f2ad960736c596eed3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.614116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 922/1829] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:42 2022] DELETE /identity/v3/users/fca34485b72c48f2ad960736c596eed3 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:43.616044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.616242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:43.616867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.634029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:43.635481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:43.672196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:43.675567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:43.964386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69398fa1-f8d6-4aba-8ee5-9c1e671a62d0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:43.994216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 908/1830] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:43.996529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:43.997647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.997940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.001372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] PATH_INFO: `/v3/projects/dc3a1791b2fb47b1b9c0d50312d822bc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.003029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3a1791b2fb47b1b9c0d50312d822bc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:44.008431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:44.067995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:44.069662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.232478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3a1791b2fb47b1b9c0d50312d822bc', 'request_id': 'req-79d3eee7-7fea-43b6-a195-f25f096540c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.276468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3a1791b2fb47b1b9c0d50312d822bc', 'request_id': 'req-79d3eee7-7fea-43b6-a195-f25f096540c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.303282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3a1791b2fb47b1b9c0d50312d822bc', 'request_id': 'req-79d3eee7-7fea-43b6-a195-f25f096540c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.322429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab31062-6582-4e0d-8da8-3c7fc6164ff3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:44.361145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] The token cache is being invalidate because project dc3a1791b2fb47b1b9c0d50312d822bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:44.364513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.367820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.379528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 923/1831] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:43 2022] DELETE /identity/v3/projects/dc3a1791b2fb47b1b9c0d50312d822bc => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:44.381123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:44.389544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.404499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:44.417700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:44.484221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f1f8-134b-4860-9f2a-5d762cdfd441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:44.484953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f1f8-134b-4860-9f2a-5d762cdfd441 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.485245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f1f8-134b-4860-9f2a-5d762cdfd441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.485526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f1f8-134b-4860-9f2a-5d762cdfd441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.489205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e805f1f8-134b-4860-9f2a-5d762cdfd441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.619116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3eee7-7fea-43b6-a195-f25f096540c8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:44.630821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:44.632353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.634163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.635224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] PATH_INFO: `/v3/users/d54fa52968aa41b4adb46020d9ae9518` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.638209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54fa52968aa41b4adb46020d9ae9518)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:44.643129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:44.682566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f1f8-134b-4860-9f2a-5d762cdfd441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:44.684489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f1f8-134b-4860-9f2a-5d762cdfd441 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:44.730231 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 909/1832] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:44.744357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0b6e-031b-4807-bed2-e65d2873f87b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.744655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0b6e-031b-4807-bed2-e65d2873f87b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.746335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0b6e-031b-4807-bed2-e65d2873f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.811060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fe3f0b6e-031b-4807-bed2-e65d2873f87b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:44.812402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fe3f0b6e-031b-4807-bed2-e65d2873f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.813362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54fa52968aa41b4adb46020d9ae9518'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.832695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 910/1833] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:44.834422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de06b6-aaea-42f0-a372-6ddd7fa96b24 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.836709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de06b6-aaea-42f0-a372-6ddd7fa96b24 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.837544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de06b6-aaea-42f0-a372-6ddd7fa96b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.876887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c2de06b6-aaea-42f0-a372-6ddd7fa96b24 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:44.878126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2de06b6-aaea-42f0-a372-6ddd7fa96b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.895667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54fa52968aa41b4adb46020d9ae9518'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.899576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 911/1834] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:44.900769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de06b6-aaea-42f0-a372-6ddd7fa96b24 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:44.926649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54fa52968aa41b4adb46020d9ae9518'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.928382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de06b6-aaea-42f0-a372-6ddd7fa96b24 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:44.945502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54fa52968aa41b4adb46020d9ae9518'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.946831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4bb07ff2-169d-4cd2-b7b1-0ca04d531e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54fa52968aa41b4adb46020d9ae9518'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.949494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:44.950191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.952046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.952327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.953103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:44.953416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:44.955064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:44.963810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 924/1835] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:44 2022] DELETE /identity/v3/users/d54fa52968aa41b4adb46020d9ae9518 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:44.968194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93065b5-b174-427d-91b7-1ea16ce50031 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.968563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93065b5-b174-427d-91b7-1ea16ce50031 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.968752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93065b5-b174-427d-91b7-1ea16ce50031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.018019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e93065b5-b174-427d-91b7-1ea16ce50031 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:45.019654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 912/1836] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:45.019943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e93065b5-b174-427d-91b7-1ea16ce50031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:45.025332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.029855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:45.057997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beae38-5a15-4cd7-9c62-8d4ff892a7f3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:45.182185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 925/1837] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:45.236748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:45.239415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.240202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.242158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.244564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:45.250074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:45.318897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 913/1838] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:45 2022] POST /identity/v3/projects => generated 373 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:45.323940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93065b5-b174-427d-91b7-1ea16ce50031 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.333774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.340326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93065b5-b174-427d-91b7-1ea16ce50031 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:45.343424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:45.402608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:45.437906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:45.486823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:45.488671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.489736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.490315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.491667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:45.494948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:45.525286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56f40-f56e-4122-959f-4ee996d715d7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:45.530481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 926/1839] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:45 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:45.535537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.538785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:45.540996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.541291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.541582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.561677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927667b-87e7-4cf0-ad87-41f83ff988b9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:45.565556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:45.567651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:45.577252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:45.578050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.578345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.578823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.580161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:45.585130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:45.602320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 914/1840] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:45.603237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 927/1841] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:45.608144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.625182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195c1fc-5ecc-412f-83ba-374e4d626a5e service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:45.633176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba92808-023e-4a47-b89b-403b79c059f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:45.634284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92808-023e-4a47-b89b-403b79c059f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.634770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92808-023e-4a47-b89b-403b79c059f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.635240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92808-023e-4a47-b89b-403b79c059f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.636166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba92808-023e-4a47-b89b-403b79c059f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:45.638029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba92808-023e-4a47-b89b-403b79c059f7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:45.655845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 915/1842] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:45.657549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.673819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815f672-78c1-48ec-bf9d-9869758de468 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:45.681479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:45.682702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.685884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.686206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] PATH_INFO: `/v3/projects/49d9d57f727f4d93825de08bc948eb71/users/122a6081e37445a9816d073afa43b226/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.718000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d9d57f727f4d93825de08bc948eb71, user_id=122a6081e37445a9816d073afa43b226, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:45.724372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:45.745720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 928/1843] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:45 2022] PUT /identity/v3/projects/49d9d57f727f4d93825de08bc948eb71/users/122a6081e37445a9816d073afa43b226/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:45.759638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad335f6-685e-4af7-9a74-9de3ec46b170 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.760003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad335f6-685e-4af7-9a74-9de3ec46b170 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.760361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad335f6-685e-4af7-9a74-9de3ec46b170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.811109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bad335f6-685e-4af7-9a74-9de3ec46b170 None None] MFA Rules not processed for user `122a6081e37445a9816d073afa43b226`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:45.812691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bad335f6-685e-4af7-9a74-9de3ec46b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:45.924223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 916/1844] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:45.926278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.000285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466fe5-444a-451d-b217-63c1a0735a15 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.000581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466fe5-444a-451d-b217-63c1a0735a15 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.000915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466fe5-444a-451d-b217-63c1a0735a15 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.003247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 917/1845] 10.222.0.45 () {54 vars in 912 bytes} [Thu Jul 21 04:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:46.015156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782e4b-8477-4de6-b9e9-0a3b7dc25d68 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.015452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782e4b-8477-4de6-b9e9-0a3b7dc25d68 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.015738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782e4b-8477-4de6-b9e9-0a3b7dc25d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.024130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72d093-444b-4850-9d81-e33d7a61576b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.029809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.030495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.030819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.031056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.033256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.034331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.052552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3a782e4b-8477-4de6-b9e9-0a3b7dc25d68 None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:46.053846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3a782e4b-8477-4de6-b9e9-0a3b7dc25d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.070848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 929/1846] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:45 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:46.071940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.074931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.145489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 918/1847] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:46.146768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782e4b-8477-4de6-b9e9-0a3b7dc25d68 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.164421 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782e4b-8477-4de6-b9e9-0a3b7dc25d68 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.215682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:46.225133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ced627-6c74-4da0-9810-899c52dbb819 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.236601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.238424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.238954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.240450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.243191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.248918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.249700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.249987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.250157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.251544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.253803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.261452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:46.262096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.263914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.279734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 919/1848] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:46 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:46.280691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.283412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.291096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 930/1849] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:46.292317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.300733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.314757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0400c2-5ea8-48a9-8f7a-ce976a50e298 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.321602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.322817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.323264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.323692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] PATH_INFO: `/v3/projects/fc610819cc69426d9b35a405e7a9ef8c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.325109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc610819cc69426d9b35a405e7a9ef8c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.327550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.394408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5acd-264a-43d0-8f6f-a987cb340dc1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.421799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc610819cc69426d9b35a405e7a9ef8c', 'request_id': 'req-ed10f922-62fc-4940-9e6e-597a5d202499'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.435277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc610819cc69426d9b35a405e7a9ef8c', 'request_id': 'req-ed10f922-62fc-4940-9e6e-597a5d202499'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.444480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc610819cc69426d9b35a405e7a9ef8c', 'request_id': 'req-ed10f922-62fc-4940-9e6e-597a5d202499'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.458321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] The token cache is being invalidate because project fc610819cc69426d9b35a405e7a9ef8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:46.458724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.459449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.461583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 931/1850] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:46 2022] DELETE /identity/v3/projects/fc610819cc69426d9b35a405e7a9ef8c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:46.462151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.464734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.465544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.465896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.466257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.468703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.468945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.483383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.486041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.497383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 920/1851] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:46.498420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.499796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.566609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f922-62fc-4940-9e6e-597a5d202499 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.572688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.573697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.574063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.574400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] PATH_INFO: `/v3/projects/908ac9d63c7c4ab3b00f8e46413aa19e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.575669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908ac9d63c7c4ab3b00f8e46413aa19e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.578008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.595879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a97c-2641-4915-859b-e51d2bb6e38c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.604996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622015e-c51c-4411-ae5b-95e34dcd53c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.605792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622015e-c51c-4411-ae5b-95e34dcd53c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.606281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622015e-c51c-4411-ae5b-95e34dcd53c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.606841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622015e-c51c-4411-ae5b-95e34dcd53c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.609052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622015e-c51c-4411-ae5b-95e34dcd53c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.610908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622015e-c51c-4411-ae5b-95e34dcd53c5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.631142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 921/1852] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:46.631142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.631142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.631142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.637633 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908ac9d63c7c4ab3b00f8e46413aa19e', 'request_id': 'req-16441f04-b1d6-4810-b1b6-858ff38a9e41'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.647986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908ac9d63c7c4ab3b00f8e46413aa19e', 'request_id': 'req-16441f04-b1d6-4810-b1b6-858ff38a9e41'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.651295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:46.652601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.656593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908ac9d63c7c4ab3b00f8e46413aa19e', 'request_id': 'req-16441f04-b1d6-4810-b1b6-858ff38a9e41'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.671373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] The token cache is being invalidate because project 908ac9d63c7c4ab3b00f8e46413aa19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:46.672715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.674132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.677216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 932/1853] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:46 2022] DELETE /identity/v3/projects/908ac9d63c7c4ab3b00f8e46413aa19e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:46.679114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.685110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.691925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:46.782415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:46.833017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 922/1854] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:46.834414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.839006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16441f04-b1d6-4810-b1b6-858ff38a9e41 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.854011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.860066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3c31b-9dac-445a-9fef-3405e591a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.861032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c31b-9dac-445a-9fef-3405e591a1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.861322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c31b-9dac-445a-9fef-3405e591a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.861608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c31b-9dac-445a-9fef-3405e591a1ce admin admin] PATH_INFO: `/v3/projects/4e3f3067556b407aa999376559600703/users/be4b65a3c63b40f8bef9a40c82872b04/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.891389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3c31b-9dac-445a-9fef-3405e591a1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3f3067556b407aa999376559600703, user_id=be4b65a3c63b40f8bef9a40c82872b04, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.895583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3c31b-9dac-445a-9fef-3405e591a1ce admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.901117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9223e-93e8-4ae5-95de-6232e9f21d64 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.914340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.915947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.916562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.917030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] PATH_INFO: `/v3/users/b03d42759b354c32b917b4254f0741e9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.919420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03d42759b354c32b917b4254f0741e9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.923138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.942761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 933/1855] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:46 2022] PUT /identity/v3/projects/4e3f3067556b407aa999376559600703/users/be4b65a3c63b40f8bef9a40c82872b04/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:46.943649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87246b4-ba23-4040-bc7f-f3c16bdcff7a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.943948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87246b4-ba23-4040-bc7f-f3c16bdcff7a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.944235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87246b4-ba23-4040-bc7f-f3c16bdcff7a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.955403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 934/1856] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:18:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:46.956375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87246b4-ba23-4040-bc7f-f3c16bdcff7a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.961135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d87246b4-ba23-4040-bc7f-f3c16bdcff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.049851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03d42759b354c32b917b4254f0741e9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.065391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03d42759b354c32b917b4254f0741e9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.065391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03d42759b354c32b917b4254f0741e9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.076677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03d42759b354c32b917b4254f0741e9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.088011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3789e49-54bc-4428-97f9-4248c4fe6126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03d42759b354c32b917b4254f0741e9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.095511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 923/1857] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:46 2022] DELETE /identity/v3/users/b03d42759b354c32b917b4254f0741e9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:47.098468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.098905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.099276 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.105042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87246b4-ba23-4040-bc7f-f3c16bdcff7a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.132128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.134504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.208189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.210403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.211606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.212077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] PATH_INFO: `/v3/projects/4cc7956b9a9a4986bc0f9a28dc2ec944` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.214127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc7956b9a9a4986bc0f9a28dc2ec944)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.224839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.228305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 924/1858] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:47.232903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.235370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.258863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af1863-35d8-4d36-9aef-e97b93179087 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.266118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7702a77-2a36-424e-b5db-dd25995577c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.267358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702a77-2a36-424e-b5db-dd25995577c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.267651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702a77-2a36-424e-b5db-dd25995577c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.267988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702a77-2a36-424e-b5db-dd25995577c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.270288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702a77-2a36-424e-b5db-dd25995577c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.272084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702a77-2a36-424e-b5db-dd25995577c3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.287450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 925/1859] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:47.288124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.288418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.288859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.311604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.313135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.320848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.340397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc7956b9a9a4986bc0f9a28dc2ec944', 'request_id': 'req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.366563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc7956b9a9a4986bc0f9a28dc2ec944', 'request_id': 'req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.375419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.379550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc7956b9a9a4986bc0f9a28dc2ec944', 'request_id': 'req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.396109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] The token cache is being invalidate because project 4cc7956b9a9a4986bc0f9a28dc2ec944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:47.396902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.398261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.403215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 935/1860] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:46 2022] DELETE /identity/v3/projects/4cc7956b9a9a4986bc0f9a28dc2ec944 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:47.404214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.406469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 926/1861] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:47.406592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.406668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.407944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.488874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc06b4-e951-4d00-bab2-0e8560c15f5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.496909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.497961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.498253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.498879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] PATH_INFO: `/v3/projects/4e3f3067556b407aa999376559600703/users/be4b65a3c63b40f8bef9a40c82872b04/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.501645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3f3067556b407aa999376559600703, user_id=be4b65a3c63b40f8bef9a40c82872b04, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.506173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.514748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4786a2-b0ff-44f7-9336-9d08e0aa4c64 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.521006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.521701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.521989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.522270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.523022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:47.523336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.525272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.539404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 927/1862] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:47 2022] PUT /identity/v3/projects/4e3f3067556b407aa999376559600703/users/be4b65a3c63b40f8bef9a40c82872b04/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:47.541779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 936/1863] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:47.546281 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.549762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.551973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.559839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b013c-63f5-402d-b76b-df4bda7105c9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.655628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123486c1-2ea1-4823-9f82-c50db3c1b28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.656711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123486c1-2ea1-4823-9f82-c50db3c1b28e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.656711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123486c1-2ea1-4823-9f82-c50db3c1b28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.656970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123486c1-2ea1-4823-9f82-c50db3c1b28e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.669153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123486c1-2ea1-4823-9f82-c50db3c1b28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.669153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123486c1-2ea1-4823-9f82-c50db3c1b28e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.676643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333018b-da41-40bd-97ed-31ab9a3e2fe0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.683242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.684603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.685656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.686196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] PATH_INFO: `/v3/users/e72678b28777420b9c96f9fafa04526d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.688141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72678b28777420b9c96f9fafa04526d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.697149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.736563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 937/1864] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:47.743641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fefba-8955-441f-b524-a2735768195c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.743941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fefba-8955-441f-b524-a2735768195c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.744293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fefba-8955-441f-b524-a2735768195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.795764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72678b28777420b9c96f9fafa04526d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.806868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f83fefba-8955-441f-b524-a2735768195c None None] MFA Rules not processed for user `be4b65a3c63b40f8bef9a40c82872b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.809072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f83fefba-8955-441f-b524-a2735768195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.812238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72678b28777420b9c96f9fafa04526d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.813644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72678b28777420b9c96f9fafa04526d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.834296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72678b28777420b9c96f9fafa04526d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.838236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.853271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72678b28777420b9c96f9fafa04526d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.870552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 928/1865] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:47 2022] DELETE /identity/v3/users/e72678b28777420b9c96f9fafa04526d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:47.871119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.875730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.887349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.989160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 938/1866] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:47.990078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fefba-8955-441f-b524-a2735768195c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.993093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f83fefba-8955-441f-b524-a2735768195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.067115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971de07-1ae1-46be-9bfa-ec57d135fc0c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.079230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c684aa9-6a7c-40d9-bc55-0c919167c7f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.079962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684aa9-6a7c-40d9-bc55-0c919167c7f3 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.080379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684aa9-6a7c-40d9-bc55-0c919167c7f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.080668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c684aa9-6a7c-40d9-bc55-0c919167c7f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.089328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0c684aa9-6a7c-40d9-bc55-0c919167c7f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.120293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c684aa9-6a7c-40d9-bc55-0c919167c7f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.122186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c684aa9-6a7c-40d9-bc55-0c919167c7f3 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.151919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 929/1867] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:48.163837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.164132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.164420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.178067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fefba-8955-441f-b524-a2735768195c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.236776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] MFA Rules not processed for user `7b1d74995a6b407698b38e4b74e53556`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:48.238430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.334781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.335303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.335632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.336491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.337245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.339220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.368293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 930/1868] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:48.369219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.373299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.414066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 939/1869] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/users => generated 293 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:48.415643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.456011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d92be-a168-4d10-b6d2-c3474374d579 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.472317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.473048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.473338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.473623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.484346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.488862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.534909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 940/1870] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:48.539100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.551174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.569790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b34c56-97ff-4115-860a-4be0374d3e39 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.579385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.580060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.580351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.580632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.584796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e2756-59f2-4118-bc8a-496f354dbab3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.596892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.597792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.598083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.599626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] PATH_INFO: `/v3/projects/77ef749aa70f4e1c9a3892071ee23b25` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.602002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ef749aa70f4e1c9a3892071ee23b25)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.604775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.644622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:48.722114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.723936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.734758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:48.737013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ef749aa70f4e1c9a3892071ee23b25', 'request_id': 'req-d54b8932-de80-423f-b4f6-85bbe4c951fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:48.750873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ef749aa70f4e1c9a3892071ee23b25', 'request_id': 'req-d54b8932-de80-423f-b4f6-85bbe4c951fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:48.755092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 931/1871] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:48.757124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.762316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ef749aa70f4e1c9a3892071ee23b25', 'request_id': 'req-d54b8932-de80-423f-b4f6-85bbe4c951fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:48.777661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] The token cache is being invalidate because project 77ef749aa70f4e1c9a3892071ee23b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:48.777959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:48.781551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d54b8932-de80-423f-b4f6-85bbe4c951fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:48.782945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122703-04a8-489b-abfb-93a82de7ff79 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.790196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 941/1872] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:48 2022] DELETE /identity/v3/projects/77ef749aa70f4e1c9a3892071ee23b25 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:48.791699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.794166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.803885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.854774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:48.858096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.971221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.972432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.972835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.973770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.974035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.975872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.009071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 932/1873] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:49.009071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.009071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.039459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 942/1874] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:49.040624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.041961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.056753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617ba68-1a79-40b2-82c1-7aa17b206d2d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.061719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.062592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.063325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.063449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] PATH_INFO: `/v3/projects/2af2e030b78645cfbedbcb3f1a8c86ab` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.064735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af2e030b78645cfbedbcb3f1a8c86ab)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.067056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.078217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d45bc-6cf6-4da1-bcac-3de20bd9c6e7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.082528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.083186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.083478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.083763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.085650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.137860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af2e030b78645cfbedbcb3f1a8c86ab', 'request_id': 'req-35b2a57d-6f22-4a41-8eaf-111c0f629b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:49.149354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af2e030b78645cfbedbcb3f1a8c86ab', 'request_id': 'req-35b2a57d-6f22-4a41-8eaf-111c0f629b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:49.154457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.156354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.157249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af2e030b78645cfbedbcb3f1a8c86ab', 'request_id': 'req-35b2a57d-6f22-4a41-8eaf-111c0f629b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:49.170102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] The token cache is being invalidate because project 2af2e030b78645cfbedbcb3f1a8c86ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:49.170545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:49.171227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-35b2a57d-6f22-4a41-8eaf-111c0f629b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:49.172034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 933/1875] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:49.173041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 943/1876] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:49 2022] DELETE /identity/v3/projects/2af2e030b78645cfbedbcb3f1a8c86ab => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:49.173418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.174376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270989-9ea0-4695-a7d4-abeb98baa0f2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.174669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270989-9ea0-4695-a7d4-abeb98baa0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.175530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe270989-9ea0-4695-a7d4-abeb98baa0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.176356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.195107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbcf94-7de6-49c8-be9c-7020ede5b032 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.196712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fe270989-9ea0-4695-a7d4-abeb98baa0f2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:49.197541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fe270989-9ea0-4695-a7d4-abeb98baa0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.226059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:49.318372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.319461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.319853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.320244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] PATH_INFO: `/v3/projects/bfe4e62ae0f74fe794b5adaf8cd10f44/users/971e77410c5f4cf78a013ef478b8c2a5/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.327196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:49.351418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 944/1877] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:49.352314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe4e62ae0f74fe794b5adaf8cd10f44, user_id=971e77410c5f4cf78a013ef478b8c2a5, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.355720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.365591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186411-0f72-4ac4-b935-80edf4d6265c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.365893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186411-0f72-4ac4-b935-80edf4d6265c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.366218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186411-0f72-4ac4-b935-80edf4d6265c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.380941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 934/1878] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:49 2022] PUT /identity/v3/projects/bfe4e62ae0f74fe794b5adaf8cd10f44/users/971e77410c5f4cf78a013ef478b8c2a5/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:49.382418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.409859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-94186411-0f72-4ac4-b935-80edf4d6265c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:49.411282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-94186411-0f72-4ac4-b935-80edf4d6265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.496712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765124d4-4fde-41b0-b113-f59a0b9a8055 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.503531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c7b59-58ac-4018-bbab-3756370a9302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.504427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7b59-58ac-4018-bbab-3756370a9302 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.504849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7b59-58ac-4018-bbab-3756370a9302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.505317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7b59-58ac-4018-bbab-3756370a9302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.506868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7b59-58ac-4018-bbab-3756370a9302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:49.507843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7b59-58ac-4018-bbab-3756370a9302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.511579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 945/1879] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:49.521708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7b16-c640-4703-95c0-c718b9e1edf9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.522202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7b16-c640-4703-95c0-c718b9e1edf9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.522802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7b16-c640-4703-95c0-c718b9e1edf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.525900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7b59-58ac-4018-bbab-3756370a9302 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.542778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 935/1880] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:49.544149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f353-0f25-4ed6-9d3a-13b12bc1fc2e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.544453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f353-0f25-4ed6-9d3a-13b12bc1fc2e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.544739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f353-0f25-4ed6-9d3a-13b12bc1fc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.564768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ba8e7b16-c640-4703-95c0-c718b9e1edf9 None None] MFA Rules not processed for user `971e77410c5f4cf78a013ef478b8c2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:49.565267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ad84f353-0f25-4ed6-9d3a-13b12bc1fc2e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:49.566518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba8e7b16-c640-4703-95c0-c718b9e1edf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.566667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ad84f353-0f25-4ed6-9d3a-13b12bc1fc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.576750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 936/1881] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:49.577753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f353-0f25-4ed6-9d3a-13b12bc1fc2e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.593137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f353-0f25-4ed6-9d3a-13b12bc1fc2e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.600139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.601028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.601423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.602187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.602827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.605243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.670768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 937/1882] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:49.671747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.689829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 946/1883] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:49.693241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7b16-c640-4703-95c0-c718b9e1edf9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.727495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7b16-c640-4703-95c0-c718b9e1edf9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.777260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e47b2-30cc-4f25-9eb1-88ec1d02532b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.791266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.803032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.803365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.803696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.804515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:49.804927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.810007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.842031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 938/1884] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:49.842929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.850789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.865049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:49.871117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa5835-86c2-4739-8bfe-1f951598afcc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.873162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.873921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.874213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.874532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.875353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.877464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.888079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.889258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.889888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.890367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.891329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.894597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.918949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 947/1885] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/users => generated 302 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:49.920038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.931632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472b53-d736-4264-bafe-6a53308980e3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.938001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.938778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.939069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.939426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.940135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.944289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.955609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 939/1886] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:49.960245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.975240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:50.026383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 948/1887] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:50.027425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.139439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d372-d72b-44ef-98b9-9206e415825f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.203655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094d8e8-56d6-4486-92dd-d9e2c0a099d0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.215716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.216422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.216706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.217465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.218175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.220130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.277417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 949/1888] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:50 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:50.279860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.305032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b6765-0b3a-41aa-ae8c-ab26c27155da admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.311107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.312281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.318995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.320461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.320775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f33401-d24e-4703-b216-dd2277dd7528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.321497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.321620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f33401-d24e-4703-b216-dd2277dd7528 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.321778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f33401-d24e-4703-b216-dd2277dd7528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.322303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f33401-d24e-4703-b216-dd2277dd7528 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.323014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f33401-d24e-4703-b216-dd2277dd7528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.325707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.326650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f33401-d24e-4703-b216-dd2277dd7528 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.373859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 950/1889] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:50 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:50.375478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3dc0d-cca9-4845-9df6-89a16700bac5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.375779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3dc0d-cca9-4845-9df6-89a16700bac5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.376064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3dc0d-cca9-4845-9df6-89a16700bac5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.381789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 940/1890] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:50.383070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.392037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 951/1891] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:18:50 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:50.393441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3dc0d-cca9-4845-9df6-89a16700bac5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.427411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c881d56-41a7-4744-a72d-c91fe921ac1b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.444563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.452915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.459608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.459986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.466182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.466731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3dc0d-cca9-4845-9df6-89a16700bac5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.474528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.494480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050276e-5ae5-4cc1-aa15-7371179eb957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.495195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050276e-5ae5-4cc1-aa15-7371179eb957 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.495456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050276e-5ae5-4cc1-aa15-7371179eb957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.495740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050276e-5ae5-4cc1-aa15-7371179eb957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.496491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050276e-5ae5-4cc1-aa15-7371179eb957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.498245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050276e-5ae5-4cc1-aa15-7371179eb957 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.555840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 941/1892] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:50.555840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.578966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89b6d-8ca9-471e-81a4-dd42965baf47 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.586454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.587148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.587436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.587718 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.589951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 952/1893] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:50.592782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893dc3-dd7f-44b5-8fc5-6fac6d0470d5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.593109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893dc3-dd7f-44b5-8fc5-6fac6d0470d5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.594020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893dc3-dd7f-44b5-8fc5-6fac6d0470d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.597900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.599707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.646620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b7893dc3-dd7f-44b5-8fc5-6fac6d0470d5 None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:50.649495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7893dc3-dd7f-44b5-8fc5-6fac6d0470d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:50.659769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 942/1894] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:50.663458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.688507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566ed2-6214-407b-8355-f7e3b936a761 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.705182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.709106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.709598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.710180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] PATH_INFO: `/v3/projects/c78c91e779904d17a0e6ff8f24993060/users/e4b7e2cabea741b4921dede815d9275b/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.747321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78c91e779904d17a0e6ff8f24993060, user_id=e4b7e2cabea741b4921dede815d9275b, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.753872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.800974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 943/1895] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:50 2022] PUT /identity/v3/projects/c78c91e779904d17a0e6ff8f24993060/users/e4b7e2cabea741b4921dede815d9275b/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:50.804700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.858572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 953/1896] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:50.878742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893dc3-dd7f-44b5-8fc5-6fac6d0470d5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.905397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:50.915501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893dc3-dd7f-44b5-8fc5-6fac6d0470d5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.955296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936eba99-128a-4f8c-9a3c-eb3bf03cad85 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.967563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.969736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.971297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.971588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.973181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.975302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.006482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 944/1897] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:51.007404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.026877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e105d9-8a2b-41eb-904e-1d0cf049c4b4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:51.035426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:51.042602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:51.042976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.043424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.043811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.044705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:51.046461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.065386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:51.066909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.067195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.067471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] PATH_INFO: `/v3/projects/64298a2e31ef459497b91185520dd1c5/users/583dcefe389d4597ab47c7f3d03d65a9/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.105586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 945/1898] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:51.105586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.109752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:51.116072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64298a2e31ef459497b91185520dd1c5, user_id=583dcefe389d4597ab47c7f3d03d65a9, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:51.131504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.164239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 954/1899] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:50 2022] PUT /identity/v3/projects/64298a2e31ef459497b91185520dd1c5/users/583dcefe389d4597ab47c7f3d03d65a9/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:51.165492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.378093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5daad-fcf8-4972-a21b-91229bd9aa51 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:51.383730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ccc21-513b-430b-aeba-406f5025a1f5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:51.390687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:51.391988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.392165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.392416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] PATH_INFO: `/v3/projects/285f889f29fc47239f92bfa46cce85f3/users/2a38014ce237453dbe3f7bdcfe1ed73f/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.435623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285f889f29fc47239f92bfa46cce85f3, user_id=2a38014ce237453dbe3f7bdcfe1ed73f, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:51.440444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.471226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 955/1900] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:51 2022] PUT /identity/v3/projects/285f889f29fc47239f92bfa46cce85f3/users/2a38014ce237453dbe3f7bdcfe1ed73f/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:51.472664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.499644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50647d8a-d90a-4f4d-82ab-3a671056989e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:51.500445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50647d8a-d90a-4f4d-82ab-3a671056989e service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.500640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50647d8a-d90a-4f4d-82ab-3a671056989e service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.500973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50647d8a-d90a-4f4d-82ab-3a671056989e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.513886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50647d8a-d90a-4f4d-82ab-3a671056989e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:51.515521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50647d8a-d90a-4f4d-82ab-3a671056989e service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.529077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 946/1901] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:51.531516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60441ae-ede3-4368-9d84-d85160024837 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.531516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60441ae-ede3-4368-9d84-d85160024837 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.531516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60441ae-ede3-4368-9d84-d85160024837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.580815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b60441ae-ede3-4368-9d84-d85160024837 None None] MFA Rules not processed for user `583dcefe389d4597ab47c7f3d03d65a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:51.583492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b60441ae-ede3-4368-9d84-d85160024837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:51.620921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768eb15-f1bb-4ea8-a95a-4d716a6826e8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:51.647071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a63f2-b6be-41c8-9d79-f86ba1ed46d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:51.648054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a63f2-b6be-41c8-9d79-f86ba1ed46d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.648337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a63f2-b6be-41c8-9d79-f86ba1ed46d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.648614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a63f2-b6be-41c8-9d79-f86ba1ed46d9 admin admin] PATH_INFO: `/v3/projects/c78c91e779904d17a0e6ff8f24993060/users/e4b7e2cabea741b4921dede815d9275b/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.650704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a63f2-b6be-41c8-9d79-f86ba1ed46d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78c91e779904d17a0e6ff8f24993060, user_id=e4b7e2cabea741b4921dede815d9275b, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:51.653507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a63f2-b6be-41c8-9d79-f86ba1ed46d9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.660077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:51.666915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 956/1902] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:51 2022] PUT /identity/v3/projects/c78c91e779904d17a0e6ff8f24993060/users/e4b7e2cabea741b4921dede815d9275b/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:51.668020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975a56-5c17-4ef4-a40a-f3f9189d1ce9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.668311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975a56-5c17-4ef4-a40a-f3f9189d1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.668593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975a56-5c17-4ef4-a40a-f3f9189d1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.697138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a8975a56-5c17-4ef4-a40a-f3f9189d1ce9 None None] MFA Rules not processed for user `2a38014ce237453dbe3f7bdcfe1ed73f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:51.698320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a8975a56-5c17-4ef4-a40a-f3f9189d1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:51.706506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 947/1903] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:51.710031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d71f-5042-48dd-bc42-8513bcb27bcb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.710330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d71f-5042-48dd-bc42-8513bcb27bcb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.710618 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d71f-5042-48dd-bc42-8513bcb27bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.743085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a103d71f-5042-48dd-bc42-8513bcb27bcb None None] MFA Rules not processed for user `e4b7e2cabea741b4921dede815d9275b`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:51.744470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a103d71f-5042-48dd-bc42-8513bcb27bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:51.754795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:51.843259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 957/1904] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:51.853214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8975a56-5c17-4ef4-a40a-f3f9189d1ce9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.890317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 948/1905] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:51.890317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d71f-5042-48dd-bc42-8513bcb27bcb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.000558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d71f-5042-48dd-bc42-8513bcb27bcb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.026923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.029092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.029403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.029612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8975a56-5c17-4ef4-a40a-f3f9189d1ce9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.030079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.032995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.039104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.039530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.041077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.041452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.041771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.042838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.052376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.106143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 949/1906] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:51 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:52.107172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.113141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:52.121422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 958/1907] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:51 2022] POST /identity/v3/projects => generated 409 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:52.122957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.238990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:52.249613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06793bb-47d1-4461-84aa-cb9c5fa255db admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.297826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3434-4c8f-467d-ab3b-231412811fd9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.303948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.304752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.305205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.305559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.306339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.308370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.329124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.330897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 959/1908] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:52.331712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.331889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.332006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.332280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.345056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eef6a-1e6c-4dbb-9450-4efe2d8a30ca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.350806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.352060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.352517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.352815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.353632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.356043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.389078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 960/1909] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/users => generated 311 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:52.390328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.413590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ec17-ae9c-4cae-852d-b222470ac83e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.446997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.459964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.464514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.465689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.471147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.472296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.481893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.482495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.544380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 961/1910] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:52.551705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 950/1911] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:52.553220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.563207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.613813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465edff6-3206-4245-82a8-192f1b87389f service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.617152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d433-f269-42ed-937e-45033258ead4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.638326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.638962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.639241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.639563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.640256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.652234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.654465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.655599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.656035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.657425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.658363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.661845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.686841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 962/1912] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:52.687976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.698078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 951/1913] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:52.701052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.712509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9abe6-e1e9-47b2-980e-54d315271613 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.712509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.712509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.712509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.713142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] PATH_INFO: `/v3/users/971e77410c5f4cf78a013ef478b8c2a5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.713142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] RBAC: Authorizing `identity:delete_user(user_id=971e77410c5f4cf78a013ef478b8c2a5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.714781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.738511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c266b-6aab-47eb-8575-55d0bf965489 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.749187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.750362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.750799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.751280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] PATH_INFO: `/v3/projects/943d6a656ea349df9b673e4a8127e7b3/users/d90d3e14a1d04b9098b82a157950f6d9/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.758425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:52.773907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943d6a656ea349df9b673e4a8127e7b3, user_id=d90d3e14a1d04b9098b82a157950f6d9, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.777083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.802025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 952/1914] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:52 2022] PUT /identity/v3/projects/943d6a656ea349df9b673e4a8127e7b3/users/d90d3e14a1d04b9098b82a157950f6d9/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:52.803802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.835878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971e77410c5f4cf78a013ef478b8c2a5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.857846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971e77410c5f4cf78a013ef478b8c2a5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.889240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971e77410c5f4cf78a013ef478b8c2a5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.915545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971e77410c5f4cf78a013ef478b8c2a5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.917801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d0692a62-5d7b-41ce-a116-d24ddf43026b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971e77410c5f4cf78a013ef478b8c2a5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.934603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 963/1915] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:52 2022] DELETE /identity/v3/users/971e77410c5f4cf78a013ef478b8c2a5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:52.934603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119d82e-3d3e-41a1-a806-75427abb8afd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.934603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119d82e-3d3e-41a1-a806-75427abb8afd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.934603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119d82e-3d3e-41a1-a806-75427abb8afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.973982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a119d82e-3d3e-41a1-a806-75427abb8afd None None] MFA Rules not processed for user `d90d3e14a1d04b9098b82a157950f6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:52.975465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967c5ed-95ac-48e2-9471-34bb96bf2656 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.976540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a119d82e-3d3e-41a1-a806-75427abb8afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.006004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.053775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.054616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.054909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.055195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] PATH_INFO: `/v3/projects/af1ad03a881c499ea404ba77e2154ab4/users/3292b0a7d7d84d51817a1ac18901c8c1/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.079871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1ad03a881c499ea404ba77e2154ab4, user_id=3292b0a7d7d84d51817a1ac18901c8c1, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.086011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 964/1916] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:53.089464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.096534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.097289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.097747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.125378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:53.126999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.140367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 953/1917] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:52 2022] PUT /identity/v3/projects/af1ad03a881c499ea404ba77e2154ab4/users/3292b0a7d7d84d51817a1ac18901c8c1/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:53.142243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.150434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.245904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 965/1918] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:53.249468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.253709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fae01-ad7b-46b5-9196-51b113880030 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.253852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.261253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.261950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.262302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.262596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.263309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.266187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.288804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072c65b-757a-49c3-b12a-2b7e53c582e6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.297041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.298041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.298628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.299347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.303753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 954/1919] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:53 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:53.303753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.305652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.306577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.307790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.332251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 966/1920] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:53.333357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.354005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94535eb-e044-46d3-94ac-a169a8e0f7d6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.359623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.403037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d421-fe31-4af8-b411-37d71c5edd76 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.408546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4676-9a95-47d3-b8ea-d79c6481e5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.410461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4676-9a95-47d3-b8ea-d79c6481e5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.411001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4676-9a95-47d3-b8ea-d79c6481e5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.411477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4676-9a95-47d3-b8ea-d79c6481e5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.438788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.439005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.439253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.439966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.440970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.450286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.478500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 967/1921] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:53 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:53.479459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.482787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.490657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f509ff4-6948-4f96-a817-70aeddb3b6d5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.496583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.497731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.498195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.498497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] PATH_INFO: `/v3/projects/af1ad03a881c499ea404ba77e2154ab4/users/3292b0a7d7d84d51817a1ac18901c8c1/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.500929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1ad03a881c499ea404ba77e2154ab4, user_id=3292b0a7d7d84d51817a1ac18901c8c1, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.503497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4676-9a95-47d3-b8ea-d79c6481e5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.503757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.506302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4676-9a95-47d3-b8ea-d79c6481e5c9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.516503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 968/1922] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:53 2022] PUT /identity/v3/projects/af1ad03a881c499ea404ba77e2154ab4/users/3292b0a7d7d84d51817a1ac18901c8c1/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:53.517145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.522971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 955/1923] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:53.527478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.527770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.528057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.557744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] MFA Rules not processed for user `3292b0a7d7d84d51817a1ac18901c8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:53.558923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.601654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605c2d-df03-4767-b9f9-68ca8392f5c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.611728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.613286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.613676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.614060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.616918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.618876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.631951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 969/1924] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:53.636553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.647662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb503c-c8a2-4a6d-bf8a-df107ef02034 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.658778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.660579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.661007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.661373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] PATH_INFO: `/v3/projects/2674738d5d0d439192d771f2d6043ce1/users/75ea010997994ee7aa3aec45a1cd0b7e/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.665143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 956/1925] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:53.678945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.680561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.685838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2674738d5d0d439192d771f2d6043ce1, user_id=75ea010997994ee7aa3aec45a1cd0b7e, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.688861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.706065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 970/1926] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:53 2022] PUT /identity/v3/projects/2674738d5d0d439192d771f2d6043ce1/users/75ea010997994ee7aa3aec45a1cd0b7e/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:53.710166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.750060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174aff-cf87-4417-a8f2-20cb04b3d0d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.790337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.803273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781d3b3-489a-4f36-97d1-404a89d45de7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.814659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.815550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.815866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.816365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.817194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.818992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.824703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.826239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.826827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.827306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.832805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 971/1927] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:18:53.836654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.852602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3fe1-3ccc-4a52-a5c3-fa506c5b8309 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.858970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6dc9e-0af0-4307-8c6a-5870acfa741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.860344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6dc9e-0af0-4307-8c6a-5870acfa741d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.860729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6dc9e-0af0-4307-8c6a-5870acfa741d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.861115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6dc9e-0af0-4307-8c6a-5870acfa741d admin admin] PATH_INFO: `/v3/projects/2674738d5d0d439192d771f2d6043ce1/users/75ea010997994ee7aa3aec45a1cd0b7e/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.863617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6dc9e-0af0-4307-8c6a-5870acfa741d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2674738d5d0d439192d771f2d6043ce1, user_id=75ea010997994ee7aa3aec45a1cd0b7e, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.866655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6dc9e-0af0-4307-8c6a-5870acfa741d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.880856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 972/1928] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:53 2022] PUT /identity/v3/projects/2674738d5d0d439192d771f2d6043ce1/users/75ea010997994ee7aa3aec45a1cd0b7e/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:53.891187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.891494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.891883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.893961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.924931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] MFA Rules not processed for user `75ea010997994ee7aa3aec45a1cd0b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:53.926589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.926702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.929003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.942332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 957/1929] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:54.081461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 973/1930] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:54.095133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.110139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6a3f-b956-4c1a-b64f-0b582cba38e2 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.185344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.189151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.189679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.189996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.202673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.204421 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.220550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 958/1931] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:54.268270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.271784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.279721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:54.281157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca7eba-7607-4950-b42c-feeb1de8be9a service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.287686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.288685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.290153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.290602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.293192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:54.386493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.388057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.409177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 959/1932] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:54.412268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.414664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:54.452667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdefe8-f0d5-4e05-a1dc-a1925f9983e1 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.493634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7585dce-347d-4262-b765-339b050ffb1c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.495992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.497492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.499653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.500400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.509574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.513259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.513716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.514487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] PATH_INFO: `/v3/projects/bfe4e62ae0f74fe794b5adaf8cd10f44` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.515589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:54.517443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe4e62ae0f74fe794b5adaf8cd10f44)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.522226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.695323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe4e62ae0f74fe794b5adaf8cd10f44', 'request_id': 'req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.707506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.708747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.729719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe4e62ae0f74fe794b5adaf8cd10f44', 'request_id': 'req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.738882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe4e62ae0f74fe794b5adaf8cd10f44', 'request_id': 'req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.740427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:54.748148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 960/1933] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:54.774354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] The token cache is being invalidate because project bfe4e62ae0f74fe794b5adaf8cd10f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:54.774612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.775564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.778454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 974/1934] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:54 2022] DELETE /identity/v3/projects/bfe4e62ae0f74fe794b5adaf8cd10f44 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:54.782069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.802251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993620c-d77e-41ca-ad06-373d96f4d677 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.833427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:54.966429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.968149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.968664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.969201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] PATH_INFO: `/v3/users/e4b7e2cabea741b4921dede815d9275b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.972196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b7e2cabea741b4921dede815d9275b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.979590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.089194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b7e2cabea741b4921dede815d9275b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.103703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b7e2cabea741b4921dede815d9275b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.104437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b7e2cabea741b4921dede815d9275b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.114163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b7e2cabea741b4921dede815d9275b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.124476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6f8b9e9b-76c4-4911-bccf-3f23469a23c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b7e2cabea741b4921dede815d9275b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.137011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 961/1935] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:54 2022] DELETE /identity/v3/users/e4b7e2cabea741b4921dede815d9275b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:55.657586 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.659568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:55.683550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4db7c-ffe8-447f-8ea0-7205aae1a47c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.742655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.743519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.743805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.744087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] PATH_INFO: `/v3/projects/c78c91e779904d17a0e6ff8f24993060` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.745310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78c91e779904d17a0e6ff8f24993060)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.747239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.792899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78c91e779904d17a0e6ff8f24993060', 'request_id': 'req-8b076310-c2ab-4ef8-9cb5-bf98a9150419'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.801093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78c91e779904d17a0e6ff8f24993060', 'request_id': 'req-8b076310-c2ab-4ef8-9cb5-bf98a9150419'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.807397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78c91e779904d17a0e6ff8f24993060', 'request_id': 'req-8b076310-c2ab-4ef8-9cb5-bf98a9150419'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.818435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] The token cache is being invalidate because project c78c91e779904d17a0e6ff8f24993060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:55.818724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.819363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8b076310-c2ab-4ef8-9cb5-bf98a9150419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:55.820972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 975/1936] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:55 2022] DELETE /identity/v3/projects/c78c91e779904d17a0e6ff8f24993060 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:55.825951 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06049a06-a92c-4b1b-b908-189f89860886 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.826423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06049a06-a92c-4b1b-b908-189f89860886 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.826551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06049a06-a92c-4b1b-b908-189f89860886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.845844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-06049a06-a92c-4b1b-b908-189f89860886 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:55.847539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-06049a06-a92c-4b1b-b908-189f89860886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:55.906006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 962/1937] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:55.915623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410198d9-7348-459a-87de-bc43d43017ee None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.916026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410198d9-7348-459a-87de-bc43d43017ee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.916336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410198d9-7348-459a-87de-bc43d43017ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.936717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-410198d9-7348-459a-87de-bc43d43017ee None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:55.937907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-410198d9-7348-459a-87de-bc43d43017ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:55.948641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 976/1938] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:55.952905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06049a06-a92c-4b1b-b908-189f89860886 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.963736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06049a06-a92c-4b1b-b908-189f89860886 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.968861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.969643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.970050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.970541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.971349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:55.972513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.974381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.986747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 963/1939] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:55.991952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410198d9-7348-459a-87de-bc43d43017ee None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.004716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410198d9-7348-459a-87de-bc43d43017ee None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.009448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.010112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.010399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.010704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.011467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.013458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.074617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 977/1940] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:55 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:56.078642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.091101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d8838-dfa3-447a-8e20-6584884f0b88 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.115712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:56.199239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.200085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.200360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.200657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.201413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.203535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.230256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 964/1941] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:56 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:56.234673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.248050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc4205-b4e1-4efd-8207-e3492fab7f1e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.258940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.259636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.259924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.260680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.261130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.262769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.275452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 978/1942] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:56.279720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.291941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eabec-c67c-4f1a-931d-f1a1f67861b4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.301562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aca9f-2ec7-4827-825a-bb5770c8b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.303306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aca9f-2ec7-4827-825a-bb5770c8b45b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.303814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aca9f-2ec7-4827-825a-bb5770c8b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.304234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aca9f-2ec7-4827-825a-bb5770c8b45b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.305773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aca9f-2ec7-4827-825a-bb5770c8b45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.308565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aca9f-2ec7-4827-825a-bb5770c8b45b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.324149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 965/1943] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:56.326610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.340562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afa6e-135e-443c-9f3e-4154e7f0490b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.353053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.353738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.354082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.354527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] PATH_INFO: `/v3/projects/8f9ceb79f2b648c0819a3597f47f6446/users/5ac11d1c43014e47bf8bac7733711448/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.374329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9ceb79f2b648c0819a3597f47f6446, user_id=5ac11d1c43014e47bf8bac7733711448, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.378910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.404875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 979/1944] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:56 2022] PUT /identity/v3/projects/8f9ceb79f2b648c0819a3597f47f6446/users/5ac11d1c43014e47bf8bac7733711448/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:56.407556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902541b-5dcb-4f85-b412-9597b0b91531 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.407860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902541b-5dcb-4f85-b412-9597b0b91531 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.408446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902541b-5dcb-4f85-b412-9597b0b91531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.460084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a902541b-5dcb-4f85-b412-9597b0b91531 None None] MFA Rules not processed for user `5ac11d1c43014e47bf8bac7733711448`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:56.464126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a902541b-5dcb-4f85-b412-9597b0b91531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:56.611621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 966/1945] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:56.620704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.659889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:56.751082 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0160e7-bd7b-4dc9-9fac-19d2955822c2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.757738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.758962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.759269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.759799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.760627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.763645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.819331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 980/1946] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:56 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:56.824945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902541b-5dcb-4f85-b412-9597b0b91531 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.842831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902541b-5dcb-4f85-b412-9597b0b91531 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.965361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.966117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.966414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.967233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.967476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.970757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:57.011649 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 967/1947] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:56 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:57.015518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:57.040245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6750a-8573-441c-a373-fea9b48e800e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:57.046763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:57.047727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.048223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.049241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.050664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:57.052564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:57.072403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 981/1948] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:57.074132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:57.087020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e97e-d52d-4471-b0d8-6b9e221af79a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:57.101562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:57.101707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.101883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.102182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] PATH_INFO: `/v3/projects/96c2dc5e26e5427e8afde7f7d40cfa23/users/119df268ea1146f89a187c047cf0acbf/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.141326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c2dc5e26e5427e8afde7f7d40cfa23, user_id=119df268ea1146f89a187c047cf0acbf, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:57.145325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:57.149010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:57.169309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 968/1949] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:57 2022] PUT /identity/v3/projects/96c2dc5e26e5427e8afde7f7d40cfa23/users/119df268ea1146f89a187c047cf0acbf/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:57.174007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:57.189325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718d27c-7464-4bc0-95be-5e2f5fede53a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:57.335438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b6bb2-a22d-435f-8593-e42b18365d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:57.336419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6bb2-a22d-435f-8593-e42b18365d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.336895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6bb2-a22d-435f-8593-e42b18365d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.337385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6bb2-a22d-435f-8593-e42b18365d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.338282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b6bb2-a22d-435f-8593-e42b18365d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:57.340076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b6bb2-a22d-435f-8593-e42b18365d96 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:57.379656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 982/1950] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:57.383897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:57.405982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34a0b-9960-4904-a290-f27c4db3c514 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:57.422955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:57.426858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.427230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.427693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] PATH_INFO: `/v3/projects/96c2dc5e26e5427e8afde7f7d40cfa23/users/119df268ea1146f89a187c047cf0acbf/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.432246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c2dc5e26e5427e8afde7f7d40cfa23, user_id=119df268ea1146f89a187c047cf0acbf, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:57.435119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:57.492815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431186-cc28-4415-a0b0-49339e3bcfd0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.493007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 969/1951] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:57 2022] PUT /identity/v3/projects/96c2dc5e26e5427e8afde7f7d40cfa23/users/119df268ea1146f89a187c047cf0acbf/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:57.493392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431186-cc28-4415-a0b0-49339e3bcfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.493688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431186-cc28-4415-a0b0-49339e3bcfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.537550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-54431186-cc28-4415-a0b0-49339e3bcfd0 None None] MFA Rules not processed for user `119df268ea1146f89a187c047cf0acbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:57.539717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-54431186-cc28-4415-a0b0-49339e3bcfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:57.694982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 983/1952] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:57.722392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:57.724059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:57.810329 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffae5-420a-44d8-b66c-c8c78bbb0839 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:57.814451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:57.815757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.815930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.816215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.831556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:57.833168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:57.844857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 970/1953] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:58.223826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431186-cc28-4415-a0b0-49339e3bcfd0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.233034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431186-cc28-4415-a0b0-49339e3bcfd0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.238297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '119df268ea1146f89a187c047cf0acbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c2dc5e26e5427e8afde7f7d40cfa23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.238965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.239252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.239530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.240259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:58.240566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.242506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.254540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 984/1954] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:58.258635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.267748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d61c9-64fd-41a6-b5f5-c3b0ec0b5a05 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.272507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '119df268ea1146f89a187c047cf0acbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c2dc5e26e5427e8afde7f7d40cfa23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.273195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.273489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.273773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.274459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.276454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.301303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 971/1955] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:58 2022] POST /identity/v3/projects => generated 355 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:58.305468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.310765 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:58.318024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b32da7-511d-44d1-96a9-fc497255d9d9 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.376017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '119df268ea1146f89a187c047cf0acbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c2dc5e26e5427e8afde7f7d40cfa23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.376690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.377018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.377313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.378615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:58.379014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.380624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.400416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 985/1956] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:58.409512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.411340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:58.438398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.451812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14117-bf5a-4313-b651-1b3bdd374d38 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.458166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '119df268ea1146f89a187c047cf0acbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96c2dc5e26e5427e8afde7f7d40cfa23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.459160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.459446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.459726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] PATH_INFO: `/v3/projects/37e7157e90f646508aa83906581ab6e3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.460923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37e7157e90f646508aa83906581ab6e3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.462823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.484685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488db1f9-0b0c-45f1-86ab-5f501f0efbca tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.491987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.492994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.493239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.493476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] PATH_INFO: `/v3/users/2a38014ce237453dbe3f7bdcfe1ed73f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.494745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a38014ce237453dbe3f7bdcfe1ed73f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.496716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.517010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e7157e90f646508aa83906581ab6e3', 'request_id': 'req-72c6005e-9db0-4f42-b98e-de6cbc125fb3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.532876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e7157e90f646508aa83906581ab6e3', 'request_id': 'req-72c6005e-9db0-4f42-b98e-de6cbc125fb3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.540032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e7157e90f646508aa83906581ab6e3', 'request_id': 'req-72c6005e-9db0-4f42-b98e-de6cbc125fb3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.552792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] The token cache is being invalidate because project 37e7157e90f646508aa83906581ab6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:58.553115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.553813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72c6005e-9db0-4f42-b98e-de6cbc125fb3 tempest-VolumeQuotaClassesTest-1091600084 tempest-VolumeQuotaClassesTest-1091600084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.555562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 986/1957] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:58 2022] DELETE /identity/v3/projects/37e7157e90f646508aa83906581ab6e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:58.559759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a38014ce237453dbe3f7bdcfe1ed73f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.576270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a38014ce237453dbe3f7bdcfe1ed73f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.576595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a38014ce237453dbe3f7bdcfe1ed73f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.578701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:58.587397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a38014ce237453dbe3f7bdcfe1ed73f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.598470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a38014ce237453dbe3f7bdcfe1ed73f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.608857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 972/1958] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:58 2022] DELETE /identity/v3/users/2a38014ce237453dbe3f7bdcfe1ed73f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:58.612531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.612872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.613161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.633724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:58.634942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:58.731400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 987/1959] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:58.735177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.736585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:58.800358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.802247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:58.809802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdf3e-e9be-430f-ba0d-07302de601ec admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.816429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1db3b-a364-4bf9-9c03-cac2b425bc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.817205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1db3b-a364-4bf9-9c03-cac2b425bc5d service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.817497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1db3b-a364-4bf9-9c03-cac2b425bc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.817844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1db3b-a364-4bf9-9c03-cac2b425bc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.818887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99a9bc-7e0c-4d50-bafc-e0b628152949 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.826646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.827867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.828260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.828668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] PATH_INFO: `/v3/users/5ac11d1c43014e47bf8bac7733711448` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.830152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac11d1c43014e47bf8bac7733711448)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.831298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1db3b-a364-4bf9-9c03-cac2b425bc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.832562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.833524 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1db3b-a364-4bf9-9c03-cac2b425bc5d service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.844525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 973/1960] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:58.849126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:58.886899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac11d1c43014e47bf8bac7733711448'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.905771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac11d1c43014e47bf8bac7733711448'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.915804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac11d1c43014e47bf8bac7733711448'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.925639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac11d1c43014e47bf8bac7733711448'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.926662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac11d1c43014e47bf8bac7733711448'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.940690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.941252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.941331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.943562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 988/1961] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:58 2022] DELETE /identity/v3/users/5ac11d1c43014e47bf8bac7733711448 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:58.960508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:58.961868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.040346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 974/1962] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:59.052404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.054760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.144390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5be05-0819-4c34-92b6-eb5cca34cbcf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.152750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.153767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.155188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.157507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.172473 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:59.173984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:59.193099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 989/1963] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:59.339098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.340570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.354212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75fd7f-3092-4c1a-ac84-350453e3574a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.368962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.370167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.370552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.370957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] PATH_INFO: `/v3/projects/285f889f29fc47239f92bfa46cce85f3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.373642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285f889f29fc47239f92bfa46cce85f3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:59.381212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:59.443975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285f889f29fc47239f92bfa46cce85f3', 'request_id': 'req-b27469a2-ee31-4a6e-856d-0b0e75fd8232'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.450461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285f889f29fc47239f92bfa46cce85f3', 'request_id': 'req-b27469a2-ee31-4a6e-856d-0b0e75fd8232'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.458304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285f889f29fc47239f92bfa46cce85f3', 'request_id': 'req-b27469a2-ee31-4a6e-856d-0b0e75fd8232'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.474706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] The token cache is being invalidate because project 285f889f29fc47239f92bfa46cce85f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:59.475082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.485192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.485192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 975/1964] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:59 2022] DELETE /identity/v3/projects/285f889f29fc47239f92bfa46cce85f3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:59.490179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.500805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d719a-ecce-4c1b-b64a-66311385fdce service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.585401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.586361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.586708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.587051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] PATH_INFO: `/v3/users/d90d3e14a1d04b9098b82a157950f6d9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.589083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90d3e14a1d04b9098b82a157950f6d9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:59.591072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:59.642383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:59.655615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90d3e14a1d04b9098b82a157950f6d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.679907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90d3e14a1d04b9098b82a157950f6d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.689675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90d3e14a1d04b9098b82a157950f6d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.697990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90d3e14a1d04b9098b82a157950f6d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.698779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90d3e14a1d04b9098b82a157950f6d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.705380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 990/1965] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:59 2022] DELETE /identity/v3/users/d90d3e14a1d04b9098b82a157950f6d9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:59.814145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.815726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.835593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27469a2-ee31-4a6e-856d-0b0e75fd8232 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.841586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:59.915124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.916044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.916327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.916606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] PATH_INFO: `/v3/projects/8f9ceb79f2b648c0819a3597f47f6446` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.918048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9ceb79f2b648c0819a3597f47f6446)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:59.920151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:59.970696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9ceb79f2b648c0819a3597f47f6446', 'request_id': 'req-509554aa-dddb-4fc2-8097-b63bd3a353f6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.978102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9ceb79f2b648c0819a3597f47f6446', 'request_id': 'req-509554aa-dddb-4fc2-8097-b63bd3a353f6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.986912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9ceb79f2b648c0819a3597f47f6446', 'request_id': 'req-509554aa-dddb-4fc2-8097-b63bd3a353f6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.999246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] The token cache is being invalidate because project 8f9ceb79f2b648c0819a3597f47f6446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:59.999547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.000218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.002101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 976/1966] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:59 2022] DELETE /identity/v3/projects/8f9ceb79f2b648c0819a3597f47f6446 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:00.005960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.008218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.022109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad59d-d040-474d-af06-5421073210e9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.081316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.082289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.082603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.082889 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] PATH_INFO: `/v3/users/119df268ea1146f89a187c047cf0acbf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.084110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119df268ea1146f89a187c047cf0acbf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.086178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.138285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119df268ea1146f89a187c047cf0acbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.152066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119df268ea1146f89a187c047cf0acbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.160480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119df268ea1146f89a187c047cf0acbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.168501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119df268ea1146f89a187c047cf0acbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.169531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119df268ea1146f89a187c047cf0acbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.179110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 991/1967] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:00 2022] DELETE /identity/v3/users/119df268ea1146f89a187c047cf0acbf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:00.475819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.477654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.505539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509554aa-dddb-4fc2-8097-b63bd3a353f6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.544478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.545955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.585280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.586178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.586464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.586748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] PATH_INFO: `/v3/projects/943d6a656ea349df9b673e4a8127e7b3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.589882 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=943d6a656ea349df9b673e4a8127e7b3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.592989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.595376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:00.654044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:00.656367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61698f-435f-49c8-8b31-eee63be4d118 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.663053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943d6a656ea349df9b673e4a8127e7b3', 'request_id': 'req-9a64bd2b-4d86-41af-9b72-98915a986176'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.670496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943d6a656ea349df9b673e4a8127e7b3', 'request_id': 'req-9a64bd2b-4d86-41af-9b72-98915a986176'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.679894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943d6a656ea349df9b673e4a8127e7b3', 'request_id': 'req-9a64bd2b-4d86-41af-9b72-98915a986176'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.692850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] The token cache is being invalidate because project 943d6a656ea349df9b673e4a8127e7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:00.693156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.693815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.695505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 977/1968] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:00 2022] DELETE /identity/v3/projects/943d6a656ea349df9b673e4a8127e7b3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:00.699993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.701343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.724208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.725355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.725466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.725680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] PATH_INFO: `/v3/projects/96c2dc5e26e5427e8afde7f7d40cfa23` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.726959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c2dc5e26e5427e8afde7f7d40cfa23)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.728941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.767400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64bd2b-4d86-41af-9b72-98915a986176 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.777370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c2dc5e26e5427e8afde7f7d40cfa23', 'request_id': 'req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.785911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c2dc5e26e5427e8afde7f7d40cfa23', 'request_id': 'req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.791689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c2dc5e26e5427e8afde7f7d40cfa23', 'request_id': 'req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.803287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] The token cache is being invalidate because project 96c2dc5e26e5427e8afde7f7d40cfa23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:00.803580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.804221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf3d651-1d7c-4836-9c4f-092b4a1732ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.805938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 992/1969] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:00 2022] DELETE /identity/v3/projects/96c2dc5e26e5427e8afde7f7d40cfa23 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:00.812450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f2d1-7602-4918-b663-ed21102afcd9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.812748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f2d1-7602-4918-b663-ed21102afcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.813057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f2d1-7602-4918-b663-ed21102afcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.826880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.827769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.828051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.828326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] PATH_INFO: `/v3/users/75ea010997994ee7aa3aec45a1cd0b7e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.829560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ea010997994ee7aa3aec45a1cd0b7e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.832124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.833454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ff37f2d1-7602-4918-b663-ed21102afcd9 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:00.834683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff37f2d1-7602-4918-b663-ed21102afcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.842602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 993/1970] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:00.850922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179ce38-9eaf-4182-88ab-8376242f3630 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.851150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179ce38-9eaf-4182-88ab-8376242f3630 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.851437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179ce38-9eaf-4182-88ab-8376242f3630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.871934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e179ce38-9eaf-4182-88ab-8376242f3630 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:00.873303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e179ce38-9eaf-4182-88ab-8376242f3630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.882575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 994/1971] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:00.884444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ea010997994ee7aa3aec45a1cd0b7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.886491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179ce38-9eaf-4182-88ab-8376242f3630 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.896257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179ce38-9eaf-4182-88ab-8376242f3630 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.897960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ea010997994ee7aa3aec45a1cd0b7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.898666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ea010997994ee7aa3aec45a1cd0b7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.900894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.901550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.901830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.902110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.902864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:00.903147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.904802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.906607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ea010997994ee7aa3aec45a1cd0b7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.913278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:00.915588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ea010997994ee7aa3aec45a1cd0b7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.921300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 995/1972] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:00.922338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.923416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 978/1973] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:00 2022] DELETE /identity/v3/users/75ea010997994ee7aa3aec45a1cd0b7e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:00.927138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.937344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115ee3-4cc7-4133-8402-8c150be56730 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.982494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:01.001955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.002770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.003063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.003345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.004035 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.006012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.036496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 996/1974] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:01.037687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.049813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90c658-104e-4dd6-a75e-d2505add97d6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.110244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.110849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.111142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.111427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.112726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.114702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.138399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 979/1975] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:01.139823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.150858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44de86-2b86-4474-92bd-870a87fa2c41 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.155817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.156515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.157391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.157391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.158225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.160450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.171649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 997/1976] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:01.176769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.196138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367e7b8-9755-4424-b8ae-bea077dd0437 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.207296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.208375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.208375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.208748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.209591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.211432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.218164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.224484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 980/1977] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:01.224738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.228586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.239882 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d726ed-ad6c-42fa-931d-4940033b40e5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.246073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a0da1-e3c1-4c78-9b90-aaf88f95853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.247075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a0da1-e3c1-4c78-9b90-aaf88f95853d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.247449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a0da1-e3c1-4c78-9b90-aaf88f95853d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.247779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a0da1-e3c1-4c78-9b90-aaf88f95853d admin admin] PATH_INFO: `/v3/projects/90f5d54adc584f37a014de1711f16f77/users/a4c949c3dd084b9db8bcd4598a3f4790/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.252489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9d51-d9f7-47e3-a34e-f7c5c979604b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.264873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.266109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.266592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.267116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] PATH_INFO: `/v3/projects/2674738d5d0d439192d771f2d6043ce1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.269455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2674738d5d0d439192d771f2d6043ce1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.271481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.276739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a0da1-e3c1-4c78-9b90-aaf88f95853d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f5d54adc584f37a014de1711f16f77, user_id=a4c949c3dd084b9db8bcd4598a3f4790, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.279744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a0da1-e3c1-4c78-9b90-aaf88f95853d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.297750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 981/1978] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:01 2022] PUT /identity/v3/projects/90f5d54adc584f37a014de1711f16f77/users/a4c949c3dd084b9db8bcd4598a3f4790/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:01.308097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.308363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.308638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.333220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2674738d5d0d439192d771f2d6043ce1', 'request_id': 'req-05529171-5eaf-4f3a-87bf-3372e14aac93'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.341714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] MFA Rules not processed for user `a4c949c3dd084b9db8bcd4598a3f4790`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:01.343042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.345221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2674738d5d0d439192d771f2d6043ce1', 'request_id': 'req-05529171-5eaf-4f3a-87bf-3372e14aac93'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.353253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2674738d5d0d439192d771f2d6043ce1', 'request_id': 'req-05529171-5eaf-4f3a-87bf-3372e14aac93'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.368177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] The token cache is being invalidate because project 2674738d5d0d439192d771f2d6043ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:01.368532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.369392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-05529171-5eaf-4f3a-87bf-3372e14aac93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.371569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 998/1979] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:01 2022] DELETE /identity/v3/projects/2674738d5d0d439192d771f2d6043ce1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:01.379121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261d01c-8e40-4a4d-a6f6-815daece36aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.379417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261d01c-8e40-4a4d-a6f6-815daece36aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.379809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261d01c-8e40-4a4d-a6f6-815daece36aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.432492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3261d01c-8e40-4a4d-a6f6-815daece36aa None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:01.434191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3261d01c-8e40-4a4d-a6f6-815daece36aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.462677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 982/1980] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:01.475547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.476814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.557668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 999/1981] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:01.568129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ee7d-1a8b-45e8-a975-d69be8f60351 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.568722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ee7d-1a8b-45e8-a975-d69be8f60351 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.569183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:01.569319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ee7d-1a8b-45e8-a975-d69be8f60351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.603942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a26d1c-c00c-4d3c-8cac-02906d15aee7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.612904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.613721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.614798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.615557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7c84ee7d-1a8b-45e8-a975-d69be8f60351 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:01.615957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.618379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c84ee7d-1a8b-45e8-a975-d69be8f60351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.637601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.640622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1000/1982] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:01.641080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.645654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ee7d-1a8b-45e8-a975-d69be8f60351 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.663339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ee7d-1a8b-45e8-a975-d69be8f60351 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.668074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 983/1983] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:01.681660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.683223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.683619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.683997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.684667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:01.685024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.686671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.718975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1001/1984] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:01.723809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.738624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e58e0-edae-44ec-b617-1a4e56098794 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.746304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.747145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.747687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.747985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.748845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.751688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.797738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 984/1985] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:01.801588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.814407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7210-9dd5-4172-9e90-1e63070fcb87 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.838762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:01.905279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.906283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.906764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.906990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.907763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.909790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.932419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1002/1986] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:01.936562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.950051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebb520-f98d-4cf0-a0f0-ff10835a69e9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.956804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.957620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.957917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.958208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.958950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.960584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.977212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 985/1987] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:01.978613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.989883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e80662-4ee8-420a-ac5b-55c6982f0ce9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.996731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3323aa-3a3b-4e77-83a6-b70f948c5532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.997543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3323aa-3a3b-4e77-83a6-b70f948c5532 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.997833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3323aa-3a3b-4e77-83a6-b70f948c5532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.998117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3323aa-3a3b-4e77-83a6-b70f948c5532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.998959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3323aa-3a3b-4e77-83a6-b70f948c5532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.000722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3323aa-3a3b-4e77-83a6-b70f948c5532 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.030829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1003/1988] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:02.035885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.054325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e442d-6d45-4012-989e-f33d0ffc27b3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.060095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.061082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.061412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.061705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] PATH_INFO: `/v3/projects/86ce5b7ea6c94e01be0f1a2b7df86290/users/24e877c20a2c41979f9e5356a214208f/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.100889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ce5b7ea6c94e01be0f1a2b7df86290, user_id=24e877c20a2c41979f9e5356a214208f, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.103781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.123057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 986/1989] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:02 2022] PUT /identity/v3/projects/86ce5b7ea6c94e01be0f1a2b7df86290/users/24e877c20a2c41979f9e5356a214208f/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:02.127212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d2f8-3065-4c7d-aecc-53d7677c4559 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.127654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d2f8-3065-4c7d-aecc-53d7677c4559 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.127974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d2f8-3065-4c7d-aecc-53d7677c4559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.150745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ee23d2f8-3065-4c7d-aecc-53d7677c4559 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:02.152104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ee23d2f8-3065-4c7d-aecc-53d7677c4559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.216195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1004/1990] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:02.226679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.228507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.293048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b977dc9-b7b8-483f-ac36-c255acbbe4d4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.296685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.297382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.297668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.297946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.307669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.309158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.318806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 987/1991] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:03.467139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acfd32-81d5-4e21-88ca-44ec5407be5c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.468047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acfd32-81d5-4e21-88ca-44ec5407be5c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.468503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acfd32-81d5-4e21-88ca-44ec5407be5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.503016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-62acfd32-81d5-4e21-88ca-44ec5407be5c None None] MFA Rules not processed for user `24e877c20a2c41979f9e5356a214208f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:03.504640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-62acfd32-81d5-4e21-88ca-44ec5407be5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:03.615049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1005/1992] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:03.620283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.637243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821dc8-8d47-409b-bf6a-0eae892dd7b3 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.649871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.650630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.650995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.652598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.653364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.655312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.718043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acfd32-81d5-4e21-88ca-44ec5407be5c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.718204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 988/1993] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:03.742033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acfd32-81d5-4e21-88ca-44ec5407be5c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.792927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:03.835410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.836096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.836387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.836678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.837463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.839384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.862579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1006/1994] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:03.869654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.881535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337bc72-6d50-473c-b0a6-ff5fadc20689 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.886548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.887333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.887629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.887915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.888651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.890313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.902286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 989/1995] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.906154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.924053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588242-6849-4b4d-9125-2202f8669a3d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.932603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.934399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.934876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.935445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] PATH_INFO: `/v3/projects/c88ba9dddfc049a2bb875f95e551cb51/users/49cfa0da618244c396807df23db6d87a/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.956057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88ba9dddfc049a2bb875f95e551cb51, user_id=49cfa0da618244c396807df23db6d87a, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.959492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.981063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1007/1996] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:03 2022] PUT /identity/v3/projects/c88ba9dddfc049a2bb875f95e551cb51/users/49cfa0da618244c396807df23db6d87a/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:03.982652 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.995355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1644-e5d1-4a97-936f-f13f97025735 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:04.051698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:04.059781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db16300-deff-4489-887e-b0e29a9311cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.060854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db16300-deff-4489-887e-b0e29a9311cd admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.061145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db16300-deff-4489-887e-b0e29a9311cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.061422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db16300-deff-4489-887e-b0e29a9311cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.062149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db16300-deff-4489-887e-b0e29a9311cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.063777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db16300-deff-4489-887e-b0e29a9311cd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.074071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 990/1997] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:04.078338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:04.089271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45945ecb-f8db-4d3a-96b5-ef8edf90861e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:04.100554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.101548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.101837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.102150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] PATH_INFO: `/v3/projects/c88ba9dddfc049a2bb875f95e551cb51/users/49cfa0da618244c396807df23db6d87a/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.104235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88ba9dddfc049a2bb875f95e551cb51, user_id=49cfa0da618244c396807df23db6d87a, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.106967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.119033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1008/1998] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:04 2022] PUT /identity/v3/projects/c88ba9dddfc049a2bb875f95e551cb51/users/49cfa0da618244c396807df23db6d87a/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:04.889921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.890851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.891127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.925661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] MFA Rules not processed for user `49cfa0da618244c396807df23db6d87a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:04.927290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:05.023957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 991/1999] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:05.032793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:05.072353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:05.074082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:05.103853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580eae3-aaea-4ebc-b8cb-ce16dfa683dd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:05.108532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:05.109730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:05.110215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:05.110567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:05.147559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f46c-131a-4d21-970d-0ca9390f219e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:05.152353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:05.153369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:05.153715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:05.154057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] PATH_INFO: `/v3/users/583dcefe389d4597ab47c7f3d03d65a9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:05.155547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583dcefe389d4597ab47c7f3d03d65a9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:05.157669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:05.191168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:05.192630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:05.202824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1009/2000] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:05.211526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583dcefe389d4597ab47c7f3d03d65a9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.233838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583dcefe389d4597ab47c7f3d03d65a9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.234894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583dcefe389d4597ab47c7f3d03d65a9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.243678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:05.245156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:05.258616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583dcefe389d4597ab47c7f3d03d65a9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.262056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff1d70-757a-472f-8d91-7a537bb6d16e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:05.265689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:05.268430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aabec851-3235-4968-b47e-290e74bfaaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583dcefe389d4597ab47c7f3d03d65a9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.270629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:05.277548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:05.277996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:05.278360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] PATH_INFO: `/v3/users/a4c949c3dd084b9db8bcd4598a3f4790` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:05.279351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 992/2001] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:05 2022] DELETE /identity/v3/users/583dcefe389d4597ab47c7f3d03d65a9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:05.282205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c949c3dd084b9db8bcd4598a3f4790)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:05.285085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:05.285827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:05.285947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:05.286455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:05.322603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:05.327355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:05.337293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:05.363012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c949c3dd084b9db8bcd4598a3f4790'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.379336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c949c3dd084b9db8bcd4598a3f4790'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.388114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c949c3dd084b9db8bcd4598a3f4790'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.401193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c949c3dd084b9db8bcd4598a3f4790'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.402285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0c2c12be-555d-4a9b-8645-81c49af75ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c949c3dd084b9db8bcd4598a3f4790'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:05.413503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1010/2002] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:05 2022] DELETE /identity/v3/users/a4c949c3dd084b9db8bcd4598a3f4790 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:05.418969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:05.419825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:05.420441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:05.422810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 993/2003] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:05.447961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:05.451356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:05.463335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:05.466437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:05.605065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1bbcc-c80b-4b7f-8467-46708f81a883 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:05.626253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1011/2004] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:05.677723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:05.679365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:05.758688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:05.760039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:05.760384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:05.760672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:05.786129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:05.790041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:05.797710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f0cf-9dee-485c-bd24-ccad91c50378 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:05.805672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5613f2-f06d-4828-be8e-fcff61989304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:05.806872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5613f2-f06d-4828-be8e-fcff61989304 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:05.807947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5613f2-f06d-4828-be8e-fcff61989304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:05.808767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5613f2-f06d-4828-be8e-fcff61989304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:05.815377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 994/2005] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:05.843512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5613f2-f06d-4828-be8e-fcff61989304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:05.845262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5613f2-f06d-4828-be8e-fcff61989304 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:05.876932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1012/2006] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:06.491521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:06.493978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:06.509241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bb187-d978-470f-9a9f-53aa4fd9278e service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:06.514864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:06.515715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:06.516008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:06.516292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] PATH_INFO: `/v3/projects/90f5d54adc584f37a014de1711f16f77` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:06.517645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f5d54adc584f37a014de1711f16f77)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:06.520848 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:06.588189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f5d54adc584f37a014de1711f16f77', 'request_id': 'req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.594960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:06.597511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f5d54adc584f37a014de1711f16f77', 'request_id': 'req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.615423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f5d54adc584f37a014de1711f16f77', 'request_id': 'req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.628279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] The token cache is being invalidate because project 90f5d54adc584f37a014de1711f16f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:06.628629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.629332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.631204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 995/2007] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:06 2022] DELETE /identity/v3/projects/90f5d54adc584f37a014de1711f16f77 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:06.636462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:06.636973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:06.637050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:06.661731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:06.663205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:06.719085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:06.723792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:06.733022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:06.753388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1013/2008] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:06.754257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:06.760287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:06.776801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796480b-68ce-41f9-bd16-6d7e55f5b7bc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:06.784466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:06.785926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:06.786351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:06.787110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] PATH_INFO: `/v3/projects/64298a2e31ef459497b91185520dd1c5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:06.788575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64298a2e31ef459497b91185520dd1c5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:06.790678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:06.794095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8920ec-5d7b-4cc3-8240-1e371ad59bec admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:06.797887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:06.798537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:06.798857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:06.799201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:06.801173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:06.841219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64298a2e31ef459497b91185520dd1c5', 'request_id': 'req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.849550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64298a2e31ef459497b91185520dd1c5', 'request_id': 'req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.856326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64298a2e31ef459497b91185520dd1c5', 'request_id': 'req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.869047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] The token cache is being invalidate because project 64298a2e31ef459497b91185520dd1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:06.869341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.869717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:06.870002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d52f1380-53b4-45d8-a9a6-42a4e3a2319c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:06.871157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:06.871608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1014/2009] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:06 2022] DELETE /identity/v3/projects/64298a2e31ef459497b91185520dd1c5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:06.873540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dde8b-5c53-4816-b2dc-7a88733d3485 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:06.873833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dde8b-5c53-4816-b2dc-7a88733d3485 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:06.874121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dde8b-5c53-4816-b2dc-7a88733d3485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:06.885598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 996/2010] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:06.886675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:06.893852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a73dde8b-5c53-4816-b2dc-7a88733d3485 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:06.895105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a73dde8b-5c53-4816-b2dc-7a88733d3485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:06.898387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea480a65-9bb2-4b8c-be7e-97eb5dd03aef service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:06.973129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:06.974066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:06.974554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:06.974846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] PATH_INFO: `/v3/users/3292b0a7d7d84d51817a1ac18901c8c1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:06.976881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1015/2011] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:06.977548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3292b0a7d7d84d51817a1ac18901c8c1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:06.979513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:06.980895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dde8b-5c53-4816-b2dc-7a88733d3485 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:06.994988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dde8b-5c53-4816-b2dc-7a88733d3485 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.000036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.000704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.001026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.001308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.002042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:07.002917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.005318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.017629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:07.022370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1016/2012] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:07.027006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.039005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f1df-c738-465c-ab2c-52cbc63bc33d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.039177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3292b0a7d7d84d51817a1ac18901c8c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.043915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.044649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.044990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.045267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.045963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.048017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.056854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3292b0a7d7d84d51817a1ac18901c8c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.057660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3292b0a7d7d84d51817a1ac18901c8c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.067300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3292b0a7d7d84d51817a1ac18901c8c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.075893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3292b0a7d7d84d51817a1ac18901c8c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.078617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1017/2013] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:07.086072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.086656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 997/2014] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:06 2022] DELETE /identity/v3/users/3292b0a7d7d84d51817a1ac18901c8c1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:07.088132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.140723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:07.177955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bba0d0-7782-435a-b981-d669070aba82 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.270672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.271492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.271636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.271908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.272678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.274611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.297940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1018/2015] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:07 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:07.302266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.312290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b311c39-92cf-4fc7-bced-b19faed4c22d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.322400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.322859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.323219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.323573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.324398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.326236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.340479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 998/2016] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:07.344403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.355102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2ee0-d49f-4967-afbd-687bc086fac0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.370346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.371672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.372068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.372454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.373987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.376545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.396959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1019/2017] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:07.398794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.415621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f2f7-cff1-49cf-83e5-057fbe50ea67 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.425444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eae22-6fb9-424d-b062-2e70349e691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.426694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eae22-6fb9-424d-b062-2e70349e691a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.427139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eae22-6fb9-424d-b062-2e70349e691a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.427678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eae22-6fb9-424d-b062-2e70349e691a admin admin] PATH_INFO: `/v3/projects/7cab2bd8008a4da6a9d152f7b99b79e0/users/58e194ed17344d28b925c37dfb593b88/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.451124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eae22-6fb9-424d-b062-2e70349e691a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cab2bd8008a4da6a9d152f7b99b79e0, user_id=58e194ed17344d28b925c37dfb593b88, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.454636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eae22-6fb9-424d-b062-2e70349e691a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.471303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.474802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.481932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 999/2018] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:07 2022] PUT /identity/v3/projects/7cab2bd8008a4da6a9d152f7b99b79e0/users/58e194ed17344d28b925c37dfb593b88/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:07.488736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.489044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.489416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.511405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:07.512705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.514721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53466cb5-a406-4969-89b4-3229f679df0b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.610165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.610165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.610527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.610664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] PATH_INFO: `/v3/projects/af1ad03a881c499ea404ba77e2154ab4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.612539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1ad03a881c499ea404ba77e2154ab4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.625037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.631462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1000/2019] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:07.642433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.644494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.717733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1ad03a881c499ea404ba77e2154ab4', 'request_id': 'req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.732068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1ad03a881c499ea404ba77e2154ab4', 'request_id': 'req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.746146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1ad03a881c499ea404ba77e2154ab4', 'request_id': 'req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.765860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d73a3-a149-4450-a4b2-40348d0810b5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.780068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:07.792191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] The token cache is being invalidate because project af1ad03a881c499ea404ba77e2154ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:07.792551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.797657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef0302a5-c5f6-41c1-b6ff-cfaf80eff903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.805981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1020/2020] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:07 2022] DELETE /identity/v3/projects/af1ad03a881c499ea404ba77e2154ab4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:07.807783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7aca6-2ba4-41c7-8eb5-f2bdd1ee8edb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.808057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7aca6-2ba4-41c7-8eb5-f2bdd1ee8edb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.808438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7aca6-2ba4-41c7-8eb5-f2bdd1ee8edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.814127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:07.852610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbd69a-1d78-4d11-888c-558b561b41da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.853771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbd69a-1d78-4d11-888c-558b561b41da service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.854115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbd69a-1d78-4d11-888c-558b561b41da service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.854468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbd69a-1d78-4d11-888c-558b561b41da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.858309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c4dbd69a-1d78-4d11-888c-558b561b41da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.872020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-91b7aca6-2ba4-41c7-8eb5-f2bdd1ee8edb None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:07.874689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91b7aca6-2ba4-41c7-8eb5-f2bdd1ee8edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.967359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbd69a-1d78-4d11-888c-558b561b41da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.968860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbd69a-1d78-4d11-888c-558b561b41da service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.980250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1001/2021] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:07.995459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1021/2022] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:08.002527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d971a-d8a4-42eb-b851-7f8bc8106209 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.002896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d971a-d8a4-42eb-b851-7f8bc8106209 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.003194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d971a-d8a4-42eb-b851-7f8bc8106209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.024550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-508d971a-d8a4-42eb-b851-7f8bc8106209 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:08.025859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-508d971a-d8a4-42eb-b851-7f8bc8106209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.035161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1002/2023] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:08.039462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7aca6-2ba4-41c7-8eb5-f2bdd1ee8edb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.054596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7aca6-2ba4-41c7-8eb5-f2bdd1ee8edb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.062624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.063575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.064850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.064850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.066196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:08.066339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.069207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.087007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1022/2024] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:08.091778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d971a-d8a4-42eb-b851-7f8bc8106209 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.101888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d971a-d8a4-42eb-b851-7f8bc8106209 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.106828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.107562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.107922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.108277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.109112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.111052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.140911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1003/2025] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:08 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:08.144510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.155105 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce90b3-fdee-4acf-ba3e-ed1625ce4ad0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.217914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.218603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.218893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.219177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.219877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.222422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.257829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1023/2026] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:08 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:08.258960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.271222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9f2d6-cb51-44d3-8694-ff748e6804be admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.277414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.277824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.278112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.278445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.279397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.281070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.305697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1004/2027] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:08.309948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.321634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ba579-ae54-47e0-8ff3-09cddfa2361a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.336963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a143f70-062a-4b01-8e80-a5aa6b1bca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.337696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a143f70-062a-4b01-8e80-a5aa6b1bca81 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.337991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a143f70-062a-4b01-8e80-a5aa6b1bca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.338296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a143f70-062a-4b01-8e80-a5aa6b1bca81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.339032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a143f70-062a-4b01-8e80-a5aa6b1bca81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.340660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a143f70-062a-4b01-8e80-a5aa6b1bca81 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.354759 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1024/2028] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:08.360428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.373423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a554b6-c0bb-44ff-bb42-8c113ddf8aaa admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.380671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.383188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.383722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.384210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] PATH_INFO: `/v3/projects/543130f999ab457e8f66a6d549054a7d/users/8b484091730b4f8b948b3ba180c108f2/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.414999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543130f999ab457e8f66a6d549054a7d, user_id=8b484091730b4f8b948b3ba180c108f2, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.421505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.449270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1005/2029] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:08 2022] PUT /identity/v3/projects/543130f999ab457e8f66a6d549054a7d/users/8b484091730b4f8b948b3ba180c108f2/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:08.462517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fd2e-698d-4f44-ac2a-b60a562b8e50 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.463653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fd2e-698d-4f44-ac2a-b60a562b8e50 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.464302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fd2e-698d-4f44-ac2a-b60a562b8e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.513924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-76c6fd2e-698d-4f44-ac2a-b60a562b8e50 None None] MFA Rules not processed for user `8b484091730b4f8b948b3ba180c108f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:08.516240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-76c6fd2e-698d-4f44-ac2a-b60a562b8e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.606984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:08.626675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.627295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1025/2030] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:08.730482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d175-adc3-4bc6-a674-9b8ede556311 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.735892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.737670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.738034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.738321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.739030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.741371 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.767425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:08.776540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1006/2031] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:08 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:08.780626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6fd2e-698d-4f44-ac2a-b60a562b8e50 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.793174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6fd2e-698d-4f44-ac2a-b60a562b8e50 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.889675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.890457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.890813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.891163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.891947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.894564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.917865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1026/2032] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:08 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:08.922088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.935552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16da7f-0328-4c74-bdd8-fbbc1a437e0c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.942949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.944099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.945021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.945534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.947351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.949345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.967360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1007/2033] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:08.972468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.994562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b193c-2575-4422-840d-600510db4b7d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.005295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.007165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.008246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.008531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] PATH_INFO: `/v3/projects/86cd510679e24cc08b6bb1d80e17bcb3/users/27dabf705ce14c329a5a7616d6f8144e/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.050575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cd510679e24cc08b6bb1d80e17bcb3, user_id=27dabf705ce14c329a5a7616d6f8144e, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.056185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.088366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.089804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1027/2034] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:08 2022] PUT /identity/v3/projects/86cd510679e24cc08b6bb1d80e17bcb3/users/27dabf705ce14c329a5a7616d6f8144e/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:09.110799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d8bf-7828-4c8e-bd12-7af7f694fb31 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.192922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000267b3-156a-4933-bf7b-a85e9400568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.194006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000267b3-156a-4933-bf7b-a85e9400568e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.194006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000267b3-156a-4933-bf7b-a85e9400568e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.194350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000267b3-156a-4933-bf7b-a85e9400568e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.195130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000267b3-156a-4933-bf7b-a85e9400568e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.197985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000267b3-156a-4933-bf7b-a85e9400568e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.216150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1008/2035] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:09.220721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.240855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d61017-7ccd-4193-ab54-d1119df7ec39 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.256897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.260676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.263879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.264511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] PATH_INFO: `/v3/projects/86cd510679e24cc08b6bb1d80e17bcb3/users/27dabf705ce14c329a5a7616d6f8144e/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.270659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cd510679e24cc08b6bb1d80e17bcb3, user_id=27dabf705ce14c329a5a7616d6f8144e, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.277489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.317013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1028/2036] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:09 2022] PUT /identity/v3/projects/86cd510679e24cc08b6bb1d80e17bcb3/users/27dabf705ce14c329a5a7616d6f8144e/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:09.327358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.328025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.328467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.361094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] MFA Rules not processed for user `27dabf705ce14c329a5a7616d6f8144e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:09.362803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.445451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1009/2037] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:09.457941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.460429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.540523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32929fec-2d63-4f8f-985f-89dec9767144 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.545492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.546378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.547278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.547278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.558200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.559733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.571341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1029/2038] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:09.701399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.703824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.740917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53837f-fbb2-45ab-9ff9-b3df30033a5e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.752245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3711-0928-40f8-a212-5cdaa5790ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.752955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3711-0928-40f8-a212-5cdaa5790ffa service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.753256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3711-0928-40f8-a212-5cdaa5790ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.753544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3711-0928-40f8-a212-5cdaa5790ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.889534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3711-0928-40f8-a212-5cdaa5790ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.889534 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3711-0928-40f8-a212-5cdaa5790ffa service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.901164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1010/2039] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:10.325563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.435428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:10.472000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4d36-dbb9-4bc6-8403-6bcead72f96b service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.479725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.481541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.482190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.482715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] PATH_INFO: `/v3/users/8b484091730b4f8b948b3ba180c108f2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.485187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b484091730b4f8b948b3ba180c108f2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.488721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.578903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b484091730b4f8b948b3ba180c108f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.605619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b484091730b4f8b948b3ba180c108f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.614121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b484091730b4f8b948b3ba180c108f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.624157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b484091730b4f8b948b3ba180c108f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.624712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b484091730b4f8b948b3ba180c108f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.633192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1030/2040] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:10 2022] DELETE /identity/v3/users/8b484091730b4f8b948b3ba180c108f2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:10.637655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.638987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.639537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.660348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:10.661629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:10.675632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:10.743584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1011/2041] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:10.753153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.754588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:10.815402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31db75-aa32-4559-a85e-626c00e7ad7a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.819176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.819832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.820121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.820403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.829873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.831623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.841789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1031/2042] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:11.193850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.195762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.243271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83bb94-4c32-461b-b2b7-30aafa52ab7c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.261112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.262011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.262302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.262631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] PATH_INFO: `/v3/projects/543130f999ab457e8f66a6d549054a7d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.263906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=543130f999ab457e8f66a6d549054a7d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.266478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.351984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543130f999ab457e8f66a6d549054a7d', 'request_id': 'req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.362827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543130f999ab457e8f66a6d549054a7d', 'request_id': 'req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.382745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543130f999ab457e8f66a6d549054a7d', 'request_id': 'req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.400091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] The token cache is being invalidate because project 543130f999ab457e8f66a6d549054a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:11.400655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.401497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.406502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1012/2043] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:11 2022] DELETE /identity/v3/projects/543130f999ab457e8f66a6d549054a7d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:11.407365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.423223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f3383-a5d4-41a0-a4d4-ec9d86feecc4 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.523109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.526032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.526434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.526812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] PATH_INFO: `/v3/users/27dabf705ce14c329a5a7616d6f8144e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.529393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dabf705ce14c329a5a7616d6f8144e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.534844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.566319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:11.680739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dabf705ce14c329a5a7616d6f8144e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.724781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dabf705ce14c329a5a7616d6f8144e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.737736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dabf705ce14c329a5a7616d6f8144e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.760736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dabf705ce14c329a5a7616d6f8144e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.762343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b36eddae-a29d-431c-a056-e435ee3d2932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dabf705ce14c329a5a7616d6f8144e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.776719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1032/2044] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:11 2022] DELETE /identity/v3/users/27dabf705ce14c329a5a7616d6f8144e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:13.219982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.222602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.237206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f5a7d-be26-41ba-a5e9-94f5cd8cda7b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.325427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.326301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.326585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.326864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] PATH_INFO: `/v3/projects/86cd510679e24cc08b6bb1d80e17bcb3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.328045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86cd510679e24cc08b6bb1d80e17bcb3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.330063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.384433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:13.400570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cd510679e24cc08b6bb1d80e17bcb3', 'request_id': 'req-cdd3cfec-aeac-4cff-afff-b6b421976a46'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.425079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cd510679e24cc08b6bb1d80e17bcb3', 'request_id': 'req-cdd3cfec-aeac-4cff-afff-b6b421976a46'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.439325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cd510679e24cc08b6bb1d80e17bcb3', 'request_id': 'req-cdd3cfec-aeac-4cff-afff-b6b421976a46'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.452605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] The token cache is being invalidate because project 86cd510679e24cc08b6bb1d80e17bcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:13.452936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.453603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cdd3cfec-aeac-4cff-afff-b6b421976a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.455240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1013/2045] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:13 2022] DELETE /identity/v3/projects/86cd510679e24cc08b6bb1d80e17bcb3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:13.460246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3478d-ea7a-4cce-92d3-ab14fd27b13e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.460747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3478d-ea7a-4cce-92d3-ab14fd27b13e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.460877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3478d-ea7a-4cce-92d3-ab14fd27b13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.492326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aef3478d-ea7a-4cce-92d3-ab14fd27b13e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:13.493810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aef3478d-ea7a-4cce-92d3-ab14fd27b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.607229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1033/2046] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:13.615674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62c9f-ad8f-41f4-a552-6f4d228db202 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.616025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62c9f-ad8f-41f4-a552-6f4d228db202 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.616652 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62c9f-ad8f-41f4-a552-6f4d228db202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.644250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9fe62c9f-ad8f-41f4-a552-6f4d228db202 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:13.645688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9fe62c9f-ad8f-41f4-a552-6f4d228db202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.661763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1014/2047] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:13.675081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3478d-ea7a-4cce-92d3-ab14fd27b13e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.700564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3478d-ea7a-4cce-92d3-ab14fd27b13e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.708737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.724185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.724482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.726318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.729712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:13.730247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.732879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.761108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1034/2048] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:13.765282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62c9f-ad8f-41f4-a552-6f4d228db202 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.776038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62c9f-ad8f-41f4-a552-6f4d228db202 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.781651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268316e-9f9f-400c-83c4-faaecf532df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.782745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268316e-9f9f-400c-83c4-faaecf532df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.783785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268316e-9f9f-400c-83c4-faaecf532df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.784247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268316e-9f9f-400c-83c4-faaecf532df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.785324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268316e-9f9f-400c-83c4-faaecf532df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.788160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268316e-9f9f-400c-83c4-faaecf532df3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.857583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1015/2049] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:13 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:13.862934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.883554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f87b74-d95e-4ad0-a920-98c17feaf84b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.911116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.911507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.911925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.970625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] MFA Rules not processed for user `58e194ed17344d28b925c37dfb593b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:13.971708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.984622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.985749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.986981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.987700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.988595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.991647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.049691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1035/2050] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:13 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:14.052497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.065948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308316-33eb-4f2c-9d7e-971950695762 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.071547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.072511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.073290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.074009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.075120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.076906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.091834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:14.092152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1036/2051] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:14.093060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1016/2052] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:14.095655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.097703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.099494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.110612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408562e7-8d8e-4f82-8227-15b487b06425 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.118075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439013a-f84c-4425-995e-8b5bc4faa672 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.121507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.122308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.122637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.122849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.123693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.124266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.124989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.125279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.125601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.126002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.127726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.130366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.154330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1037/2053] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:14.155590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.174495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1017/2054] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:14.178498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.190934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c462f-890e-437e-83a5-562e1ff99083 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.290898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c83012-424c-490b-ad68-1abdf6674131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.291817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83012-424c-490b-ad68-1abdf6674131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.292108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83012-424c-490b-ad68-1abdf6674131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.296244 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83012-424c-490b-ad68-1abdf6674131 admin admin] PATH_INFO: `/v3/projects/27c9583496e24aca8290872a22eaaa33/users/908b14b9f6e94a95b3b1ac3d2bc6c742/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.316311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c83012-424c-490b-ad68-1abdf6674131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c9583496e24aca8290872a22eaaa33, user_id=908b14b9f6e94a95b3b1ac3d2bc6c742, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.319121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c83012-424c-490b-ad68-1abdf6674131 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.343666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1038/2055] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:14 2022] PUT /identity/v3/projects/27c9583496e24aca8290872a22eaaa33/users/908b14b9f6e94a95b3b1ac3d2bc6c742/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:14.349788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feddcc-73b0-4f0f-a767-bb34c8d2505e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.358361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d21d-ca3a-44c2-a775-6f43c5e16495 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.358665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d21d-ca3a-44c2-a775-6f43c5e16495 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.359002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d21d-ca3a-44c2-a775-6f43c5e16495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.366539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:14.419208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cf37d21d-ca3a-44c2-a775-6f43c5e16495 None None] MFA Rules not processed for user `908b14b9f6e94a95b3b1ac3d2bc6c742`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:14.423328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cf37d21d-ca3a-44c2-a775-6f43c5e16495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.510097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.511140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.511431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.511713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.513213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.515308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.574609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1018/2056] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:14 2022] POST /identity/v3/users => generated 299 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:14.580946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.596244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf775d-5a95-4130-a43b-fcf87b5ec645 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.609330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.610226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.610616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.611050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.612505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.614677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.629107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1019/2057] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:14.635521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.641944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1039/2058] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:14.656508 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26d97-5cf7-48f0-b74c-5eeff56bdc16 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.682152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.684961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.685345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.685841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] PATH_INFO: `/v3/projects/361394746ccd4f50acb1ef143aaae2f5/users/e0a2f163fd194939be368d46e9bd5dd2/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.721313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361394746ccd4f50acb1ef143aaae2f5, user_id=e0a2f163fd194939be368d46e9bd5dd2, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.724787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.745758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1020/2059] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:14 2022] PUT /identity/v3/projects/361394746ccd4f50acb1ef143aaae2f5/users/e0a2f163fd194939be368d46e9bd5dd2/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:14.749530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37d21d-ca3a-44c2-a775-6f43c5e16495 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.775357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37d21d-ca3a-44c2-a775-6f43c5e16495 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.792558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.794738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.888370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:14.900240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.900953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b672-3a04-44e7-92db-68a5bb3a4227 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.901142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.901841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.902155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.903187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.904848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.906935 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e413b5-c690-40d8-9b04-5d985fc42480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.907830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e413b5-c690-40d8-9b04-5d985fc42480 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.909058 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e413b5-c690-40d8-9b04-5d985fc42480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.909449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e413b5-c690-40d8-9b04-5d985fc42480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.921185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1040/2060] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:14.924059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.939629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf8fb6-a9ae-4752-ae05-73f95f675066 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.948182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.949466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.949762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.950050 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] PATH_INFO: `/v3/projects/361394746ccd4f50acb1ef143aaae2f5/users/e0a2f163fd194939be368d46e9bd5dd2/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.952608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] RBAC: Authorizing `identity:create_grant(project_id=361394746ccd4f50acb1ef143aaae2f5, user_id=e0a2f163fd194939be368d46e9bd5dd2, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.956194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.976865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1041/2061] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:14 2022] PUT /identity/v3/projects/361394746ccd4f50acb1ef143aaae2f5/users/e0a2f163fd194939be368d46e9bd5dd2/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:14.987096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e413b5-c690-40d8-9b04-5d985fc42480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.988416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e413b5-c690-40d8-9b04-5d985fc42480 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.998668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1021/2062] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:15.019393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.136608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97a21-90a8-4b3f-ab18-cbe2da8c492a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.142513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.144023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.144354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.144639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] PATH_INFO: `/v3/users/908b14b9f6e94a95b3b1ac3d2bc6c742` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.146483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] RBAC: Authorizing `identity:delete_user(user_id=908b14b9f6e94a95b3b1ac3d2bc6c742)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.148929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.212536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908b14b9f6e94a95b3b1ac3d2bc6c742'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.235457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908b14b9f6e94a95b3b1ac3d2bc6c742'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.245565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908b14b9f6e94a95b3b1ac3d2bc6c742'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.256591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908b14b9f6e94a95b3b1ac3d2bc6c742'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.258183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908b14b9f6e94a95b3b1ac3d2bc6c742'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.266882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1042/2063] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:15 2022] DELETE /identity/v3/users/908b14b9f6e94a95b3b1ac3d2bc6c742 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:15.271730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.272027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.272312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.300763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:15.300763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.318639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:15.375080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1022/2064] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:15.394818 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.396492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.515989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4d6de-4ff0-4122-b6a2-713937e0774a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.521751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ec833-5e23-4f63-88e8-470a23bb52dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.522677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ec833-5e23-4f63-88e8-470a23bb52dc service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.523170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ec833-5e23-4f63-88e8-470a23bb52dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.523610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ec833-5e23-4f63-88e8-470a23bb52dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.540662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ec833-5e23-4f63-88e8-470a23bb52dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.542510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ec833-5e23-4f63-88e8-470a23bb52dc service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.561089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1043/2065] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:16.346183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.348319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.371030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4f90-1859-4a19-8fd9-443a5ff7c036 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.377549 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.379788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.380242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.380682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] PATH_INFO: `/v3/projects/27c9583496e24aca8290872a22eaaa33` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.382113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c9583496e24aca8290872a22eaaa33)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.386158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.480076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c9583496e24aca8290872a22eaaa33', 'request_id': 'req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.489525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c9583496e24aca8290872a22eaaa33', 'request_id': 'req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.505623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c9583496e24aca8290872a22eaaa33', 'request_id': 'req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.530346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] The token cache is being invalidate because project 27c9583496e24aca8290872a22eaaa33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:16.530772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.531703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5e26094-9f65-4068-aaa3-b342f6ccb6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.534495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1023/2066] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:16 2022] DELETE /identity/v3/projects/27c9583496e24aca8290872a22eaaa33 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:16.540173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326d50-fba5-452a-889d-611f5fc274aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.540640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326d50-fba5-452a-889d-611f5fc274aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.540748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326d50-fba5-452a-889d-611f5fc274aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.568681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:16.605976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-29326d50-fba5-452a-889d-611f5fc274aa None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:16.607240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-29326d50-fba5-452a-889d-611f5fc274aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.735604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1044/2067] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:16.745294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c88d3-e0d5-4dea-a31f-36ddb67600aa None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.745857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c88d3-e0d5-4dea-a31f-36ddb67600aa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.746359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c88d3-e0d5-4dea-a31f-36ddb67600aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.776363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e51c88d3-e0d5-4dea-a31f-36ddb67600aa None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:16.778213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e51c88d3-e0d5-4dea-a31f-36ddb67600aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.800710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1024/2068] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:16.806429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326d50-fba5-452a-889d-611f5fc274aa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.818750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326d50-fba5-452a-889d-611f5fc274aa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.825419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.827014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.827493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.828243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.830412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:16.831070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.832936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.849119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1045/2069] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:16.853386 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c88d3-e0d5-4dea-a31f-36ddb67600aa None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.864313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c88d3-e0d5-4dea-a31f-36ddb67600aa None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.893704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.894826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.895310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.895767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.896655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.900714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.970992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1025/2070] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:16.971847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.982374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cc0c0-e672-4236-8e0b-2f20331bc68f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.125846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.126536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.127383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.127667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.128368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.131018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.160385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1046/2071] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:17.164251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.177516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20595850-912f-4901-8cc3-a81315138b60 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.182596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.183268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.183555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.183880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.184615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.186266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.207330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.217569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1026/2072] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:17.220812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74050-0946-44c8-b88a-c25ce665041e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.228283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038fab-c31d-4a6e-856e-ebe431bbcb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.229021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fab-c31d-4a6e-856e-ebe431bbcb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.230868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fab-c31d-4a6e-856e-ebe431bbcb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.230868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fab-c31d-4a6e-856e-ebe431bbcb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.231410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038fab-c31d-4a6e-856e-ebe431bbcb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.233161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038fab-c31d-4a6e-856e-ebe431bbcb6a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.251119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.253771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1047/2073] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:17.275269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d2a1-a362-4e17-96c1-2a4ea428bd3d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.280387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.281309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.281612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.281880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] PATH_INFO: `/v3/projects/0e46d376457f45fb831df07e9bd60b58/users/b02006761da04411958b03f59fcd022d/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.319985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e46d376457f45fb831df07e9bd60b58, user_id=b02006761da04411958b03f59fcd022d, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.322415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.371871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1027/2074] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:17 2022] PUT /identity/v3/projects/0e46d376457f45fb831df07e9bd60b58/users/b02006761da04411958b03f59fcd022d/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:17.377653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa8a6-2e8c-47d9-aec3-ae833160417b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.378169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa8a6-2e8c-47d9-aec3-ae833160417b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.378563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa8a6-2e8c-47d9-aec3-ae833160417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.434953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3edaa8a6-2e8c-47d9-aec3-ae833160417b None None] MFA Rules not processed for user `b02006761da04411958b03f59fcd022d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:17.436222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3edaa8a6-2e8c-47d9-aec3-ae833160417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:17.506569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:17.511560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1048/2075] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:17.526193 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.528292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:17.595283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:17.661934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277db6a-06ae-431d-9495-87cf10fced68 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.678292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.678970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.679257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.679675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.691467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.693451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.708419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1028/2076] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:21.596638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975f022-7c3d-4ad3-99e0-bf38643648e2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.597255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975f022-7c3d-4ad3-99e0-bf38643648e2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.597255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975f022-7c3d-4ad3-99e0-bf38643648e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.647208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e975f022-7c3d-4ad3-99e0-bf38643648e2 None None] MFA Rules not processed for user `e0a2f163fd194939be368d46e9bd5dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:21.648849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e975f022-7c3d-4ad3-99e0-bf38643648e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.762553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1049/2077] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:21.777001 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.778750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.794179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b579-2f70-4cb3-b5e8-f760f64c7f10 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.799206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.800110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.800712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.801261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.803760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.920328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.922150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.950551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1029/2078] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:22.243781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.244342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.244814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.282981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:22.284227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.416888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1050/2079] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:22.430585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.432294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.569157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea8cc5-8517-4aad-90cb-1c7de72b5d03 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.576538 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.577381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.577752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.578568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.590431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.592670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.604375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1030/2080] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:19:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:19:28.932454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:28.943666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:29.033596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46104-1886-4188-a635-014b50b9c759 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:29.038384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:29.039291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:29.039291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:29.040005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] PATH_INFO: `/v3/users/24e877c20a2c41979f9e5356a214208f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:29.041287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e877c20a2c41979f9e5356a214208f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:29.043697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:29.091455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:29.109204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e877c20a2c41979f9e5356a214208f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.123030 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e877c20a2c41979f9e5356a214208f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.136617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e877c20a2c41979f9e5356a214208f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.147874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e877c20a2c41979f9e5356a214208f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.148732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e877c20a2c41979f9e5356a214208f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.156242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1051/2081] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:28 2022] DELETE /identity/v3/users/24e877c20a2c41979f9e5356a214208f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:29.380218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:29.405143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5adc3-f8b1-4f0e-9f67-c7b3ef5bc6c7 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:29.488952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:29.530241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:29.531090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:29.531378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:29.531657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] PATH_INFO: `/v3/projects/86ce5b7ea6c94e01be0f1a2b7df86290` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:29.539830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ce5b7ea6c94e01be0f1a2b7df86290)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:29.542471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:29.643315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ce5b7ea6c94e01be0f1a2b7df86290', 'request_id': 'req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.650728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ce5b7ea6c94e01be0f1a2b7df86290', 'request_id': 'req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.668953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ce5b7ea6c94e01be0f1a2b7df86290', 'request_id': 'req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.686383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] The token cache is being invalidate because project 86ce5b7ea6c94e01be0f1a2b7df86290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:29.686779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.687589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.690812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1031/2082] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:29 2022] DELETE /identity/v3/projects/86ce5b7ea6c94e01be0f1a2b7df86290 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:29.694822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:29.697867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:29.715743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c11a7-6962-4402-ad45-ddbc766f6b88 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:29.867536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:29.868499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:29.869587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:29.869587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] PATH_INFO: `/v3/users/49cfa0da618244c396807df23db6d87a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:29.874377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cfa0da618244c396807df23db6d87a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:29.880212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:29.990341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cfa0da618244c396807df23db6d87a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.022163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cfa0da618244c396807df23db6d87a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.035968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cfa0da618244c396807df23db6d87a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.055023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cfa0da618244c396807df23db6d87a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.055918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2d7ca0af-17fa-4e1d-b176-90bf665b26ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cfa0da618244c396807df23db6d87a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.072881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1052/2083] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:29 2022] DELETE /identity/v3/users/49cfa0da618244c396807df23db6d87a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:30.332349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.333836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.359973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04672f5-50e0-4b23-aafd-5a29a4e7d70f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.466283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.467162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.467450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.467729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] PATH_INFO: `/v3/projects/c88ba9dddfc049a2bb875f95e551cb51` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.468975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88ba9dddfc049a2bb875f95e551cb51)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.471053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:30.540667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88ba9dddfc049a2bb875f95e551cb51', 'request_id': 'req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.549710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88ba9dddfc049a2bb875f95e551cb51', 'request_id': 'req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.562426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88ba9dddfc049a2bb875f95e551cb51', 'request_id': 'req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.580604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] The token cache is being invalidate because project c88ba9dddfc049a2bb875f95e551cb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:30.580924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.581669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb00ac3d-4fab-4592-9bc2-341e9f842b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.583316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1032/2084] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:30 2022] DELETE /identity/v3/projects/c88ba9dddfc049a2bb875f95e551cb51 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:30.588558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fc7e-b508-4b8c-8330-aa12966d699c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.588855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fc7e-b508-4b8c-8330-aa12966d699c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.589149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fc7e-b508-4b8c-8330-aa12966d699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.609888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0d19fc7e-b508-4b8c-8330-aa12966d699c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:30.612601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0d19fc7e-b508-4b8c-8330-aa12966d699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.641101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:30.699353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1053/2085] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:30.710547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dcfb-86a1-4719-862f-e7991e1f594e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.710747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dcfb-86a1-4719-862f-e7991e1f594e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.711355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dcfb-86a1-4719-862f-e7991e1f594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.734949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7059dcfb-86a1-4719-862f-e7991e1f594e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:30.737058 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7059dcfb-86a1-4719-862f-e7991e1f594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.748470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1033/2086] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:30.749722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19fc7e-b508-4b8c-8330-aa12966d699c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.763974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19fc7e-b508-4b8c-8330-aa12966d699c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.769656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.770331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.770658 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.770886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.771628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:30.771940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.773572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:30.792000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1054/2087] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:30.793249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059dcfb-86a1-4719-862f-e7991e1f594e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.798501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:30.810042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059dcfb-86a1-4719-862f-e7991e1f594e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.823693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.825629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.826133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.826726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.827613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.829896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:30.868493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1034/2088] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:30.873392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.890358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf5947-a17b-4a87-9d3c-aa4c32c700a9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.973160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.973975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.974273 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.974621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.979496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.982377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.012039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1055/2089] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:31.015934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.027284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed46b-b4dc-4bb3-b7d4-9252a2398751 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.040065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.040065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.041617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.041617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.041617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.043077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.057744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1035/2090] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:31.062326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.073738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bb6ba-a70e-442a-b957-3bd483cd891a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.084443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b00701-27fd-4625-9fc3-88573bcf851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.085307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b00701-27fd-4625-9fc3-88573bcf851b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.085697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b00701-27fd-4625-9fc3-88573bcf851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.086079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b00701-27fd-4625-9fc3-88573bcf851b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.086941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b00701-27fd-4625-9fc3-88573bcf851b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.088869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b00701-27fd-4625-9fc3-88573bcf851b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.107527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1056/2091] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:31.112456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.125725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211f31-4083-4969-8f70-edfc70af3112 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.131106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.132008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.132295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.132577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] PATH_INFO: `/v3/projects/8d7e5964bf964ab793513a93a5d3c5dc/users/74d9ffc513d34ce2b8ab5eff49dd49f6/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.160568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7e5964bf964ab793513a93a5d3c5dc, user_id=74d9ffc513d34ce2b8ab5eff49dd49f6, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.163467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.203365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1036/2092] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:31 2022] PUT /identity/v3/projects/8d7e5964bf964ab793513a93a5d3c5dc/users/74d9ffc513d34ce2b8ab5eff49dd49f6/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:31.223643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507561-8467-4048-a289-33d7fe2e61d6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.223938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507561-8467-4048-a289-33d7fe2e61d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.224309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507561-8467-4048-a289-33d7fe2e61d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.279800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd507561-8467-4048-a289-33d7fe2e61d6 None None] MFA Rules not processed for user `74d9ffc513d34ce2b8ab5eff49dd49f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:31.281242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd507561-8467-4048-a289-33d7fe2e61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:31.411282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1057/2093] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:31.416529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.517236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687d72-71a4-48b2-adc7-38a8279c6835 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.524427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.525220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.525585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.525939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.526714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.528777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.564879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1037/2094] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:31 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:31.568083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd507561-8467-4048-a289-33d7fe2e61d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.585031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd507561-8467-4048-a289-33d7fe2e61d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.608739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:31.662107 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.663061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.663394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.663684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.664433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.669344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.693487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1058/2095] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:31 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:31.697501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.710182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba37dd-c3d2-4346-84c0-12d736cb58f6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.715146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.715841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.716109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.716394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.717157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.718783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.733212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1038/2096] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:31.737475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.747989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092b548-055e-4b51-81f8-49d8083f1a21 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.753532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.754421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.754736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.755017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] PATH_INFO: `/v3/projects/585e2bd7c7974a0eadf3d2383dd8bae1/users/d1342ffbfcac4b3fa5331ea34e7e464a/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.772916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585e2bd7c7974a0eadf3d2383dd8bae1, user_id=d1342ffbfcac4b3fa5331ea34e7e464a, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.775593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.791707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1059/2097] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:31 2022] PUT /identity/v3/projects/585e2bd7c7974a0eadf3d2383dd8bae1/users/d1342ffbfcac4b3fa5331ea34e7e464a/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:31.795733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.807917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97847d-c430-4be2-a97b-e43136dbb8ed admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.878389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bac57-8109-43dd-a6ea-643cbadafaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.879233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bac57-8109-43dd-a6ea-643cbadafaae admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.879527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bac57-8109-43dd-a6ea-643cbadafaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.879807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bac57-8109-43dd-a6ea-643cbadafaae admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.880562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bac57-8109-43dd-a6ea-643cbadafaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.882473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bac57-8109-43dd-a6ea-643cbadafaae admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.900279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1039/2098] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:31.901897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.914229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3ff4-655e-43b6-b88e-be5fccd388f6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.928452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.929482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.929833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.930179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] PATH_INFO: `/v3/projects/585e2bd7c7974a0eadf3d2383dd8bae1/users/d1342ffbfcac4b3fa5331ea34e7e464a/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.932425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] RBAC: Authorizing `identity:create_grant(project_id=585e2bd7c7974a0eadf3d2383dd8bae1, user_id=d1342ffbfcac4b3fa5331ea34e7e464a, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.935281 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.948496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1060/2099] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:31 2022] PUT /identity/v3/projects/585e2bd7c7974a0eadf3d2383dd8bae1/users/d1342ffbfcac4b3fa5331ea34e7e464a/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:31.960060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d483c4-1d66-416b-9e98-d7947481028e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.960351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d483c4-1d66-416b-9e98-d7947481028e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.960633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d483c4-1d66-416b-9e98-d7947481028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.989488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-92d483c4-1d66-416b-9e98-d7947481028e None None] MFA Rules not processed for user `d1342ffbfcac4b3fa5331ea34e7e464a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:31.990721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-92d483c4-1d66-416b-9e98-d7947481028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:31.997917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:32.104670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1040/2100] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:32.126574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:32.128385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:32.250716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e30ca-840d-4868-8630-cc4552fd013e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:32.250716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:32.250716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:32.250716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:32.251883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:32.352727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:32.354540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:32.367448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1061/2101] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:36.389005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.389583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.389583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.412061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] MFA Rules not processed for user `58e194ed17344d28b925c37dfb593b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:36.413351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.482998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1041/2102] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:37.115016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.126739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118016e5-1369-4fd3-8efc-ae8bf449ad7e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:37.131412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58649-053c-452a-a22d-998811959816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:37.132422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58649-053c-452a-a22d-998811959816 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:37.132908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58649-053c-452a-a22d-998811959816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:37.133370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58649-053c-452a-a22d-998811959816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:37.144580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58649-053c-452a-a22d-998811959816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:37.146408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58649-053c-452a-a22d-998811959816 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:37.173328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1062/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:37.979682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.981230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.054708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db95ed-81a2-4df4-8dda-dd679cf482c7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.060301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.061569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.061856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.062137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] PATH_INFO: `/v3/users/122a6081e37445a9816d073afa43b226` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.063387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122a6081e37445a9816d073afa43b226)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.065424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.118434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122a6081e37445a9816d073afa43b226'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.121954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:38.136185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122a6081e37445a9816d073afa43b226'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.137334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122a6081e37445a9816d073afa43b226'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.146274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122a6081e37445a9816d073afa43b226'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.153735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122a6081e37445a9816d073afa43b226'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.164380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1042/2104] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:37 2022] DELETE /identity/v3/users/122a6081e37445a9816d073afa43b226 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:38.168875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.169371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.169485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.188533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:38.189803 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.210739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:38.285490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1063/2105] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:38.299619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.301123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.386445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe928-9e36-43a5-a540-611a42bd4063 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.392697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.393419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.393788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.394140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.406199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.407787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.425425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1043/2106] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:39.018599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.020482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.051907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70ec7-3ba6-42b1-86be-cf46365c003e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.067119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.068131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.068644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.069059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] PATH_INFO: `/v3/projects/49d9d57f727f4d93825de08bc948eb71` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.070858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d9d57f727f4d93825de08bc948eb71)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.073208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.154124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d9d57f727f4d93825de08bc948eb71', 'request_id': 'req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.187393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d9d57f727f4d93825de08bc948eb71', 'request_id': 'req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.210650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d9d57f727f4d93825de08bc948eb71', 'request_id': 'req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.246933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] The token cache is being invalidate because project 49d9d57f727f4d93825de08bc948eb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:39.247220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.247882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1a5aef5-b94b-4729-9407-6c2cfe77fa7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.249477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1064/2107] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:39 2022] DELETE /identity/v3/projects/49d9d57f727f4d93825de08bc948eb71 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:39.254631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.269191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346e9b-e5dc-400e-a6ec-9311af24ec99 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.339867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.341035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.341496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.341835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] PATH_INFO: `/v3/users/be4b65a3c63b40f8bef9a40c82872b04` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.343112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4b65a3c63b40f8bef9a40c82872b04)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.345799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.424269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4b65a3c63b40f8bef9a40c82872b04'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.428611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.428991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.429441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.446665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4b65a3c63b40f8bef9a40c82872b04'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.448249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4b65a3c63b40f8bef9a40c82872b04'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.457183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:39.461451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:39.463207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.466629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4b65a3c63b40f8bef9a40c82872b04'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.483037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4b65a3c63b40f8bef9a40c82872b04'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.492400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1044/2108] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:39 2022] DELETE /identity/v3/users/be4b65a3c63b40f8bef9a40c82872b04 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:39.566953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1065/2109] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:39.582876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.584531 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.726481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95210b-48df-4fdc-996c-78c80bfcc86c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.736882 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefe6e9-95d3-4dc2-b544-9a3798b3f911 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.737830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefe6e9-95d3-4dc2-b544-9a3798b3f911 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.738175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefe6e9-95d3-4dc2-b544-9a3798b3f911 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.738527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefe6e9-95d3-4dc2-b544-9a3798b3f911 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.846741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefe6e9-95d3-4dc2-b544-9a3798b3f911 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.848172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefe6e9-95d3-4dc2-b544-9a3798b3f911 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.859623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1045/2110] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:19:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:19:39.941711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.943334 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.974009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e8938-b8e2-45ce-991a-fdff7cd683af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.071865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:40.113946 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.114753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.115036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.115312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] PATH_INFO: `/v3/projects/4e3f3067556b407aa999376559600703` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.118448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3f3067556b407aa999376559600703)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.123605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.259595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3f3067556b407aa999376559600703', 'request_id': 'req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.274059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3f3067556b407aa999376559600703', 'request_id': 'req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.287553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3f3067556b407aa999376559600703', 'request_id': 'req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.312874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] The token cache is being invalidate because project 4e3f3067556b407aa999376559600703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:40.320278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.324671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.332617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1066/2111] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:39 2022] DELETE /identity/v3/projects/4e3f3067556b407aa999376559600703 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:40.334656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a13044-2d67-43b3-a6a3-7ca95ff23575 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.335307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a13044-2d67-43b3-a6a3-7ca95ff23575 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.335401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a13044-2d67-43b3-a6a3-7ca95ff23575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.371448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-28a13044-2d67-43b3-a6a3-7ca95ff23575 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:40.373860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-28a13044-2d67-43b3-a6a3-7ca95ff23575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:40.552462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.554168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:40.565518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1046/2112] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:40.571907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb5d4b-dcf7-4a69-be85-01ca0213ec15 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.572588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb5d4b-dcf7-4a69-be85-01ca0213ec15 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.573101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb5d4b-dcf7-4a69-be85-01ca0213ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.577518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18748-7da7-4921-9e8e-f8bebdfb6c70 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.595379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.596218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.596491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.606218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] PATH_INFO: `/v3/users/1e4883f7b657491189ac4012d1bee604` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.613612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-89cb5d4b-dcf7-4a69-be85-01ca0213ec15 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:40.614059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4883f7b657491189ac4012d1bee604)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.616074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-89cb5d4b-dcf7-4a69-be85-01ca0213ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:40.621557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.632064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1047/2113] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:40.633163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb5d4b-dcf7-4a69-be85-01ca0213ec15 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.644700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb5d4b-dcf7-4a69-be85-01ca0213ec15 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.650381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.651822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.652105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.652396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.653177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:40.653490 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.655400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.684335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1048/2114] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:40.685510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.698788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729027de-1d15-478e-a925-ead53a56d91e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.706976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.707737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.708023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.708310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.710074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.712605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.719980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:40.771833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4883f7b657491189ac4012d1bee604'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.798708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1049/2115] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:40 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:40.802607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.851610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4883f7b657491189ac4012d1bee604'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.869989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4883f7b657491189ac4012d1bee604'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.893729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4883f7b657491189ac4012d1bee604'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.897230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4883f7b657491189ac4012d1bee604'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:40.911988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1067/2116] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:40 2022] DELETE /identity/v3/users/1e4883f7b657491189ac4012d1bee604 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:41.003627 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752b2d0-b8cd-4104-9b21-83c2fbd872ac admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.138261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.139419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.153799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.155644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.156504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.159973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.214316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1050/2117] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:40 2022] POST /identity/v3/users => generated 283 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:41.216483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.218581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:41.242332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620216b-6813-47d6-b144-b7b17e94dc25 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.254935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.260054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.260692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.260692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.261814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.264514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.285368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1068/2118] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:41.288576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.310707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bd8c3-a42a-4ab3-9d2b-7c822060b87a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.325674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f35f3d-0409-420d-b781-4759d233a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.326744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35f3d-0409-420d-b781-4759d233a152 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.327033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35f3d-0409-420d-b781-4759d233a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.327316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f35f3d-0409-420d-b781-4759d233a152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.330098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f35f3d-0409-420d-b781-4759d233a152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.341158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f35f3d-0409-420d-b781-4759d233a152 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.380158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1051/2119] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:41.385186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.408333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0eabb-e0e8-45b9-b969-59c6260a5d4c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.413374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.414599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.414993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.415266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] PATH_INFO: `/v3/projects/89825b92c6e94345b988d67f67bcf07a/users/89d8d95a3d7f4bea997a6f643775fe39/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.443401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89825b92c6e94345b988d67f67bcf07a, user_id=89d8d95a3d7f4bea997a6f643775fe39, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.449072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.473822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1069/2120] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:41 2022] PUT /identity/v3/projects/89825b92c6e94345b988d67f67bcf07a/users/89d8d95a3d7f4bea997a6f643775fe39/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:41.486043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8821-cac5-4055-8fd5-2af9434cbf5d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.486682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8821-cac5-4055-8fd5-2af9434cbf5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.487315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8821-cac5-4055-8fd5-2af9434cbf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.529613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a42d8821-cac5-4055-8fd5-2af9434cbf5d None None] MFA Rules not processed for user `89d8d95a3d7f4bea997a6f643775fe39`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:41.531154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a42d8821-cac5-4055-8fd5-2af9434cbf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:41.628407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.630915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:41.633213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1052/2121] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:41.636209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d8821-cac5-4055-8fd5-2af9434cbf5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.645933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:41.661197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:41.778455 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d8821-cac5-4055-8fd5-2af9434cbf5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.785599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.786672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.786971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.787494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.788784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.792189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.815333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90654a38-9f1e-4cdd-a619-70f658190e21 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.822153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.824157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.824599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.825353 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] PATH_INFO: `/v3/projects/909760d49d5b4a1ba59f088f139d4799` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.826969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=909760d49d5b4a1ba59f088f139d4799)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.830823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.839160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1053/2122] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:41 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:41.841302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.936771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909760d49d5b4a1ba59f088f139d4799', 'request_id': 'req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.949178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909760d49d5b4a1ba59f088f139d4799', 'request_id': 'req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.960235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909760d49d5b4a1ba59f088f139d4799', 'request_id': 'req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.975267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058b069-96d7-40f8-8085-8c8bc4bbd5ad admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.987144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] The token cache is being invalidate because project 909760d49d5b4a1ba59f088f139d4799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:41.988064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.989259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c718d68b-d3ae-4233-b16b-8e26d8c8ebbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.991503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1070/2123] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:41 2022] DELETE /identity/v3/projects/909760d49d5b4a1ba59f088f139d4799 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:41.997209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2dc08-d3e2-47ae-b8dd-125a241eb76f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.997662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2dc08-d3e2-47ae-b8dd-125a241eb76f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.998039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2dc08-d3e2-47ae-b8dd-125a241eb76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.025231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-feb2dc08-d3e2-47ae-b8dd-125a241eb76f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:42.026592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-feb2dc08-d3e2-47ae-b8dd-125a241eb76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.120591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.121446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.121792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.127625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.130939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.138590 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.162531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1071/2124] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:42.164221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3dd1-626e-4f73-b98e-3ebd07f7a16e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.164516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3dd1-626e-4f73-b98e-3ebd07f7a16e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.164806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3dd1-626e-4f73-b98e-3ebd07f7a16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.170182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1054/2125] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:41 2022] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:42.176287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.189710 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.191094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0a5e3dd1-626e-4f73-b98e-3ebd07f7a16e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:42.192669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0a5e3dd1-626e-4f73-b98e-3ebd07f7a16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.216924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c0bff-7945-4063-9e57-a4694e07ecbe admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.223283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.223975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.224284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.224747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.225790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.226301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1072/2126] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:42.227745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.230553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e3dd1-626e-4f73-b98e-3ebd07f7a16e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.240421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e3dd1-626e-4f73-b98e-3ebd07f7a16e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.244909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1055/2127] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:42.247755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.248433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.248721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.249040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.249787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:42.250096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.251787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.255075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.269314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b4cf-848a-411d-9350-04d076e4af38 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.288018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.288965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.289272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.289536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] PATH_INFO: `/v3/projects/6c5c50e35637498983fe6923c90e8402/users/c50ca90ef71943edb7618e6d734c41f6/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.295983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1073/2128] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:42.296981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.322312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da7041-eaf3-4f33-94e3-0a6873e299f5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.333554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.334216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.334511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.334842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.335488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.336556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:42.337489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.362992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5c50e35637498983fe6923c90e8402, user_id=c50ca90ef71943edb7618e6d734c41f6, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.372469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.391762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:42.399949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1056/2129] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:42 2022] PUT /identity/v3/projects/6c5c50e35637498983fe6923c90e8402/users/c50ca90ef71943edb7618e6d734c41f6/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:42.403502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.407287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1074/2130] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/projects => generated 355 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:42.411589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.543055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365d2b-c67c-4bd4-8e85-7bda052cf189 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.547925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70400-7215-4c1d-b760-3226972e813d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.549659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.550569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.550868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.553913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.555529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.558439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.564656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.565675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.566190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.566673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.567619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.569654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.591716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1057/2131] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:42.595241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.597217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1075/2132] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/users => generated 278 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:42.601314 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.620899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8940be-f7ee-4a97-a9ea-7c62c73153ff admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.636166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fed55f-9932-4954-aa49-d8ab6d48ce20 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.636350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636a44e-aa56-49e9-ac23-c56b59cf0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.639100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636a44e-aa56-49e9-ac23-c56b59cf0ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.640404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636a44e-aa56-49e9-ac23-c56b59cf0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.642675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636a44e-aa56-49e9-ac23-c56b59cf0ab7 admin admin] PATH_INFO: `/v3/projects/6c5c50e35637498983fe6923c90e8402/users/c50ca90ef71943edb7618e6d734c41f6/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.648264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636a44e-aa56-49e9-ac23-c56b59cf0ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5c50e35637498983fe6923c90e8402, user_id=c50ca90ef71943edb7618e6d734c41f6, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.651534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.653638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.654159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.655859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.656741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636a44e-aa56-49e9-ac23-c56b59cf0ab7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.657676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.661452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.689558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1076/2133] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:42.693483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.698894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1058/2134] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:42 2022] PUT /identity/v3/projects/6c5c50e35637498983fe6923c90e8402/users/c50ca90ef71943edb7618e6d734c41f6/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:42.706675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da916fcb-9706-4769-9dfc-7eaea13869cc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.710274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3447de-98c5-4fde-8f2a-39543bf5df84 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.710583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3447de-98c5-4fde-8f2a-39543bf5df84 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.710876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3447de-98c5-4fde-8f2a-39543bf5df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.804734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6d3447de-98c5-4fde-8f2a-39543bf5df84 None None] MFA Rules not processed for user `c50ca90ef71943edb7618e6d734c41f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:42.806418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6d3447de-98c5-4fde-8f2a-39543bf5df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.819831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.820632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.821155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.821545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.822399 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.824155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.837150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1077/2135] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:42.838227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.840407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.887481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e246-827a-4544-bcc8-0472fd52803a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.906557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.916974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.917934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.919931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] PATH_INFO: `/v3/users/74d9ffc513d34ce2b8ab5eff49dd49f6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.923617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d9ffc513d34ce2b8ab5eff49dd49f6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.928994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.957568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1059/2136] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:42.958654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3447de-98c5-4fde-8f2a-39543bf5df84 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.988095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3447de-98c5-4fde-8f2a-39543bf5df84 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.995597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.997055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.997443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.997957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] PATH_INFO: `/v3/projects/51630f0a37134b2995adb145444a9448/users/55c6e6d7ad704d1d89701dadda9b9f5a/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.055900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51630f0a37134b2995adb145444a9448, user_id=55c6e6d7ad704d1d89701dadda9b9f5a, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.064494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.101983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d9ffc513d34ce2b8ab5eff49dd49f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:43.116910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1060/2137] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:42 2022] PUT /identity/v3/projects/51630f0a37134b2995adb145444a9448/users/55c6e6d7ad704d1d89701dadda9b9f5a/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:43.116910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.123653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.136314 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d9ffc513d34ce2b8ab5eff49dd49f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:43.144536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.151098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d9ffc513d34ce2b8ab5eff49dd49f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:43.176173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d9ffc513d34ce2b8ab5eff49dd49f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:43.176925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-56a39ae2-fe65-4ae1-97b5-3e08a228c685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d9ffc513d34ce2b8ab5eff49dd49f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:43.189001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1078/2138] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:42 2022] DELETE /identity/v3/users/74d9ffc513d34ce2b8ab5eff49dd49f6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:43.190589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4570-3234-40d9-8bfd-bc6fe1cc9eda None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.190964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4570-3234-40d9-8bfd-bc6fe1cc9eda None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.191312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4570-3234-40d9-8bfd-bc6fe1cc9eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.203051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.229514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a5c4570-3234-40d9-8bfd-bc6fe1cc9eda None None] MFA Rules not processed for user `55c6e6d7ad704d1d89701dadda9b9f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:43.231022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a5c4570-3234-40d9-8bfd-bc6fe1cc9eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.259849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25617dd-2d45-47dd-9b8f-cca938923045 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.332657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.333464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.333849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.334228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.336390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1079/2139] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:43.339292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45363c-5365-4072-883b-a98764706261 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.339996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.340412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45363c-5365-4072-883b-a98764706261 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.341263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45363c-5365-4072-883b-a98764706261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.367952 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-df45363c-5365-4072-883b-a98764706261 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:43.379398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df45363c-5365-4072-883b-a98764706261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.437396 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.441336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.473493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1061/2140] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:43.475256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.479859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.518798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1080/2141] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:43.533059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45363c-5365-4072-883b-a98764706261 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.540959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df45363c-5365-4072-883b-a98764706261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.650004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ba05-d786-4087-a94f-c27a1e36e54e service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.655520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.656194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.656527 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.657495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.658553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.660489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.677822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45363c-5365-4072-883b-a98764706261 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.683714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.684460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.684918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.685236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.696194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.697909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.705252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1062/2142] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/projects => generated 357 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:43.708024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.710690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.713878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1081/2143] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:43.714898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.728108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53aea-8368-4104-b16b-acd301f8e01b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.770397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.779753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.882256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d37c0-290c-4577-921b-048f3127cee6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.888486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.889319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.889718 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.890097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.895436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.897311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.899065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.899322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.899647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.902987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.905909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.959604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1082/2144] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:43.963236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:44.002435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02d1f-110b-443f-b9fc-fb17a3a52ea4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:44.013998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.015093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:44.015639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.015780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.016723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.017074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.017886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.019444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.037319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1063/2145] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:44.046850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1083/2146] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:44.050788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:44.074893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878bb9f-e107-4a7b-a5d1-76ae4c827477 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:44.081666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:44.083204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.083721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.084241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] PATH_INFO: `/v3/projects/83cd586afe6f40c98d5117edbdb9a4b8/users/a35aa5ba664c445b9a8230a648b8477a/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.103928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cd586afe6f40c98d5117edbdb9a4b8, user_id=a35aa5ba664c445b9a8230a648b8477a, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.106930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.158768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1084/2147] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:44 2022] PUT /identity/v3/projects/83cd586afe6f40c98d5117edbdb9a4b8/users/a35aa5ba664c445b9a8230a648b8477a/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:44.160897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:44.187175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968b44-912d-4230-88f4-6ef574b2b30b service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:44.349384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:44.350148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.350442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.350787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.351600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.354235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.404925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1064/2148] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:44.405787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:44.407526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:44.407950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:44.435857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54b95b-6165-473e-a580-911cf8ae136e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:44.439923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf6260-f731-4000-acc2-dc8bff62163c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:44.448208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:44.451012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.451547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.452028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] PATH_INFO: `/v3/projects/8d7e5964bf964ab793513a93a5d3c5dc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.453768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7e5964bf964ab793513a93a5d3c5dc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.454657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244f814-bea9-41c9-bb1e-b9edccf75af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:44.455588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f814-bea9-41c9-bb1e-b9edccf75af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.455881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f814-bea9-41c9-bb1e-b9edccf75af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.456170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f814-bea9-41c9-bb1e-b9edccf75af0 admin admin] PATH_INFO: `/v3/projects/83cd586afe6f40c98d5117edbdb9a4b8/users/a35aa5ba664c445b9a8230a648b8477a/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.457370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.464152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244f814-bea9-41c9-bb1e-b9edccf75af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cd586afe6f40c98d5117edbdb9a4b8, user_id=a35aa5ba664c445b9a8230a648b8477a, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.475197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244f814-bea9-41c9-bb1e-b9edccf75af0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.504488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1065/2149] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:44 2022] PUT /identity/v3/projects/83cd586afe6f40c98d5117edbdb9a4b8/users/a35aa5ba664c445b9a8230a648b8477a/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:44.506409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.506648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.506938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.560277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7e5964bf964ab793513a93a5d3c5dc', 'request_id': 'req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.564854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] MFA Rules not processed for user `a35aa5ba664c445b9a8230a648b8477a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:44.564854 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:44.569938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7e5964bf964ab793513a93a5d3c5dc', 'request_id': 'req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.584484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7e5964bf964ab793513a93a5d3c5dc', 'request_id': 'req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.601151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] The token cache is being invalidate because project 8d7e5964bf964ab793513a93a5d3c5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:44.602365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.603387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.605500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1085/2150] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:44 2022] DELETE /identity/v3/projects/8d7e5964bf964ab793513a93a5d3c5dc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:44.609512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:44.612413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:44.693728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:44.729468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:44.740288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94a44a-8ef1-4a24-b7f7-73b2fdf7149b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:44.746406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1066/2151] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:44 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:44.759641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:44.759983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:44.760542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.760922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.761204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] PATH_INFO: `/v3/users/d1342ffbfcac4b3fa5331ea34e7e464a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.761516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:44.763221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1342ffbfcac4b3fa5331ea34e7e464a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.769837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.864084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402d355-3f1c-4dc9-85e7-34a4d4596b8c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:44.870961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:44.871942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:44.872320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:44.872741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.878242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1342ffbfcac4b3fa5331ea34e7e464a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.888218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.890340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.907867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1067/2152] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:44 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:44.925198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1342ffbfcac4b3fa5331ea34e7e464a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.945153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1342ffbfcac4b3fa5331ea34e7e464a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.968097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1342ffbfcac4b3fa5331ea34e7e464a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.969072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1342ffbfcac4b3fa5331ea34e7e464a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:44.979763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1086/2153] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:44 2022] DELETE /identity/v3/users/d1342ffbfcac4b3fa5331ea34e7e464a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:45.025277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:45.035212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383fe4-6ea1-45ff-9fa2-36cfa5d9ef05 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:45.150676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35295819-f5f5-4d86-83d1-459377403c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:45.151378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295819-f5f5-4d86-83d1-459377403c64 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:45.151665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295819-f5f5-4d86-83d1-459377403c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:45.152483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295819-f5f5-4d86-83d1-459377403c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:45.154743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-35295819-f5f5-4d86-83d1-459377403c64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:45.269461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35295819-f5f5-4d86-83d1-459377403c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:45.271331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35295819-f5f5-4d86-83d1-459377403c64 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:45.294944 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1068/2154] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:45 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:45.541013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:45.542638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:45.708915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210f52d-d94a-4e7b-87f7-c80d08956e12 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:45.714313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:45.715649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:45.716023 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:45.716310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] PATH_INFO: `/v3/projects/585e2bd7c7974a0eadf3d2383dd8bae1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:45.717468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=585e2bd7c7974a0eadf3d2383dd8bae1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:45.719588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:45.808161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585e2bd7c7974a0eadf3d2383dd8bae1', 'request_id': 'req-e3de842f-0358-491f-8f6a-9203bad31b5d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:45.824350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585e2bd7c7974a0eadf3d2383dd8bae1', 'request_id': 'req-e3de842f-0358-491f-8f6a-9203bad31b5d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:45.841748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585e2bd7c7974a0eadf3d2383dd8bae1', 'request_id': 'req-e3de842f-0358-491f-8f6a-9203bad31b5d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:45.862537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] The token cache is being invalidate because project 585e2bd7c7974a0eadf3d2383dd8bae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:45.862820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:45.863489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3de842f-0358-491f-8f6a-9203bad31b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:45.869034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1087/2155] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:45 2022] DELETE /identity/v3/projects/585e2bd7c7974a0eadf3d2383dd8bae1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:45.871922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2072dd-c118-4802-a7c9-15f03d935c00 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:45.872456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2072dd-c118-4802-a7c9-15f03d935c00 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:45.872686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2072dd-c118-4802-a7c9-15f03d935c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:45.901528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fe2072dd-c118-4802-a7c9-15f03d935c00 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:45.903187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fe2072dd-c118-4802-a7c9-15f03d935c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:45.946877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:45.966608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1069/2156] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:45.976960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f61a-b34b-4848-97eb-29befc4a53f9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:45.977315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f61a-b34b-4848-97eb-29befc4a53f9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:45.977664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f61a-b34b-4848-97eb-29befc4a53f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:45.991640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:45.998038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3da5f61a-b34b-4848-97eb-29befc4a53f9 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:45.999830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3da5f61a-b34b-4848-97eb-29befc4a53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:46.011550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1088/2157] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:46.016018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2072dd-c118-4802-a7c9-15f03d935c00 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.026589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2072dd-c118-4802-a7c9-15f03d935c00 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.031337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.032548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.033012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.033298 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.034031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:46.034337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.036027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.049771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1070/2158] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:46.057809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5f61a-b34b-4848-97eb-29befc4a53f9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.067894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5f61a-b34b-4848-97eb-29befc4a53f9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.073025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.073738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.074014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.074294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.075419 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.077496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.110750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1089/2159] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:46 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:46.115305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.126737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318de23-8f21-4a90-90ec-79439897b94f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.221983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.222753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.223079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.223326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.224076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.226706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.272994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1071/2160] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:46 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:46.277114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.295839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1daee-4577-48d7-a980-945c6cb92ab9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.311304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.312644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.314459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.314745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.317740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.319825 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.332198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1090/2161] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:46.336252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.347865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c651e-1fcf-4e13-9075-86f2b3283e2e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.352532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799f6cb-fedf-46e8-b99b-49da3df71594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.353234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799f6cb-fedf-46e8-b99b-49da3df71594 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.353517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799f6cb-fedf-46e8-b99b-49da3df71594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.353966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799f6cb-fedf-46e8-b99b-49da3df71594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.354708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799f6cb-fedf-46e8-b99b-49da3df71594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.356326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799f6cb-fedf-46e8-b99b-49da3df71594 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.370560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1072/2162] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:46.371861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.382637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509e38-abd2-47f1-8231-f93fa5c5a78e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.387343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.388222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.388511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.388807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] PATH_INFO: `/v3/projects/7082c103be804645bf1f9115cfc1ac5b/users/57a9e1a3cc024c748ed0d94b9db598f1/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.404048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7082c103be804645bf1f9115cfc1ac5b, user_id=57a9e1a3cc024c748ed0d94b9db598f1, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.408496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.422946 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1091/2163] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:46 2022] PUT /identity/v3/projects/7082c103be804645bf1f9115cfc1ac5b/users/57a9e1a3cc024c748ed0d94b9db598f1/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:46.434743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf7238-4b96-4a92-82e4-46dc4aa47af0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.435202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf7238-4b96-4a92-82e4-46dc4aa47af0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.435447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf7238-4b96-4a92-82e4-46dc4aa47af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.465857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6ddf7238-4b96-4a92-82e4-46dc4aa47af0 None None] MFA Rules not processed for user `57a9e1a3cc024c748ed0d94b9db598f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:46.466763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6ddf7238-4b96-4a92-82e4-46dc4aa47af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:46.559671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1073/2164] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:46.564403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.638335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90b87-f6a6-42b8-adf4-64901f71ae42 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.658448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.659324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.659709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.660056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.660932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.663025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.717996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1092/2165] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:46 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:46.719357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf7238-4b96-4a92-82e4-46dc4aa47af0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.740629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf7238-4b96-4a92-82e4-46dc4aa47af0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.796447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:46.829034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.830037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.830395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.830746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.831517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.833588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.856860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1074/2166] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:46 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:46.860031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.870573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9846221-a6f3-4843-9452-bf58e7d9d244 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.875915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.876593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.876910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.877187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.877904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.879538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.890131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1093/2167] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:46.894972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.905372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c0161-cd7c-4d5f-b8e4-2c6c7107c351 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.910451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.916299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.916299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.916299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] PATH_INFO: `/v3/projects/4400bf21f5aa4050a88a6efb9a3d8110/users/22a7923c0c6646e3b4ffa6081be12eb8/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.938269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4400bf21f5aa4050a88a6efb9a3d8110, user_id=22a7923c0c6646e3b4ffa6081be12eb8, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.941788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.959557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1075/2168] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:46 2022] PUT /identity/v3/projects/4400bf21f5aa4050a88a6efb9a3d8110/users/22a7923c0c6646e3b4ffa6081be12eb8/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:46.963644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.974789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35179b7-4ca1-4bc6-8604-9a8ce0f2f484 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.034302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca5002-ce70-451e-801e-1bc06506eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.034993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5002-ce70-451e-801e-1bc06506eff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.035267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5002-ce70-451e-801e-1bc06506eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.035546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5002-ce70-451e-801e-1bc06506eff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.036272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca5002-ce70-451e-801e-1bc06506eff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.037931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca5002-ce70-451e-801e-1bc06506eff6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.049416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1094/2169] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:47.053681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.065087 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893bf40-988f-4f1f-8a35-7bf522a44335 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.070008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.070939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.071216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.071503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] PATH_INFO: `/v3/projects/4400bf21f5aa4050a88a6efb9a3d8110/users/22a7923c0c6646e3b4ffa6081be12eb8/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.073637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4400bf21f5aa4050a88a6efb9a3d8110, user_id=22a7923c0c6646e3b4ffa6081be12eb8, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.076407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.087587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1076/2170] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:47 2022] PUT /identity/v3/projects/4400bf21f5aa4050a88a6efb9a3d8110/users/22a7923c0c6646e3b4ffa6081be12eb8/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:47.097976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.098277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.098564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.123793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:47.128654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] MFA Rules not processed for user `22a7923c0c6646e3b4ffa6081be12eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:47.130899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.186950 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.189606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.229939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1095/2171] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:47.254202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.256228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.306965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05883e06-37aa-4b72-863d-16088605ce82 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.320632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.321859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.322225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.322791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] PATH_INFO: `/v3/users/89d8d95a3d7f4bea997a6f643775fe39` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.325626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d8d95a3d7f4bea997a6f643775fe39)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.327600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.344173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9489c5-88fe-4cc2-b1ec-e20f9b930be6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.347979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.348631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.348946 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.349232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.387757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d8d95a3d7f4bea997a6f643775fe39'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.404089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d8d95a3d7f4bea997a6f643775fe39'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.404971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d8d95a3d7f4bea997a6f643775fe39'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.416221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d8d95a3d7f4bea997a6f643775fe39'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.427099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1843dba8-a0c6-48fa-ae7f-11e5d783a597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d8d95a3d7f4bea997a6f643775fe39'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.438677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1077/2172] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:47 2022] DELETE /identity/v3/users/89d8d95a3d7f4bea997a6f643775fe39 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:47.444337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.444655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.444969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.479131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:47.488343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.488721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.492959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.502475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:47.509311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1096/2173] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:47.596177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1078/2174] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:47.606737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.608978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.757513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b34e22-7535-44e9-9c41-edaea3f8c788 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.770420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:47.837462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.838171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.838744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.839073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.886292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.887857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.902298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1097/2175] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:48.349846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.354598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:48.381873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acf4c-db80-4bfc-ad2a-dbeded4edc5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.387674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.388705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.389109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.389509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] PATH_INFO: `/v3/projects/89825b92c6e94345b988d67f67bcf07a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.391051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=89825b92c6e94345b988d67f67bcf07a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.393821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.514015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89825b92c6e94345b988d67f67bcf07a', 'request_id': 'req-06129bf8-4db5-43c2-8aca-6f732b46c6ac'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.526931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89825b92c6e94345b988d67f67bcf07a', 'request_id': 'req-06129bf8-4db5-43c2-8aca-6f732b46c6ac'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.549694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89825b92c6e94345b988d67f67bcf07a', 'request_id': 'req-06129bf8-4db5-43c2-8aca-6f732b46c6ac'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.573061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] The token cache is being invalidate because project 89825b92c6e94345b988d67f67bcf07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:48.573458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.574216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.575876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1079/2176] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:48 2022] DELETE /identity/v3/projects/89825b92c6e94345b988d67f67bcf07a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:48.580638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.590649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7388f5-0b6c-4d8f-85cf-9a6fb6baa63f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.706798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.708461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.708937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.709387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] PATH_INFO: `/v3/users/c50ca90ef71943edb7618e6d734c41f6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.710824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50ca90ef71943edb7618e6d734c41f6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.713405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.828924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50ca90ef71943edb7618e6d734c41f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.864376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50ca90ef71943edb7618e6d734c41f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.877144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50ca90ef71943edb7618e6d734c41f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.908012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50ca90ef71943edb7618e6d734c41f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.909180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a42bf49a-29e5-4b5d-8e91-64d62a8ecdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50ca90ef71943edb7618e6d734c41f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.928039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1098/2177] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:48 2022] DELETE /identity/v3/users/c50ca90ef71943edb7618e6d734c41f6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:49.359070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:49.363109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:49.398365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06129bf8-4db5-43c2-8aca-6f732b46c6ac admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.480482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.481713 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.482066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.482445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] PATH_INFO: `/v3/projects/6c5c50e35637498983fe6923c90e8402` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.483848 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5c50e35637498983fe6923c90e8402)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.486584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.531478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:49.548359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5c50e35637498983fe6923c90e8402', 'request_id': 'req-e161f13a-1236-48b9-aab6-10d2eac298f0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.555021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5c50e35637498983fe6923c90e8402', 'request_id': 'req-e161f13a-1236-48b9-aab6-10d2eac298f0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.563468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5c50e35637498983fe6923c90e8402', 'request_id': 'req-e161f13a-1236-48b9-aab6-10d2eac298f0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.576560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] The token cache is being invalidate because project 6c5c50e35637498983fe6923c90e8402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:49.577004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.577741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e161f13a-1236-48b9-aab6-10d2eac298f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.579459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1080/2178] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:49 2022] DELETE /identity/v3/projects/6c5c50e35637498983fe6923c90e8402 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:49.584454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70cb2-7198-4619-883d-d53e47caddee None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.584750 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70cb2-7198-4619-883d-d53e47caddee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.585072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e70cb2-7198-4619-883d-d53e47caddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.603496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-59e70cb2-7198-4619-883d-d53e47caddee None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:49.604748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-59e70cb2-7198-4619-883d-d53e47caddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:49.633416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:49.670813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1099/2179] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:49.679284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b261fc-03ab-4439-bf69-fdb173554908 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.679647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b261fc-03ab-4439-bf69-fdb173554908 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.679995 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b261fc-03ab-4439-bf69-fdb173554908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.698889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c3b261fc-03ab-4439-bf69-fdb173554908 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:49.700113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c3b261fc-03ab-4439-bf69-fdb173554908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:49.709078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1081/2180] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:49.713376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70cb2-7198-4619-883d-d53e47caddee None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:49.723962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e70cb2-7198-4619-883d-d53e47caddee None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.728764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.729474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.729757 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.730033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.730776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:49.731086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.732692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.752944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1100/2181] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:49.754640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b261fc-03ab-4439-bf69-fdb173554908 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:49.767538 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b261fc-03ab-4439-bf69-fdb173554908 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.776392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.777077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.777444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.777926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.778786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.780928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.821252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1082/2182] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:49 2022] POST /identity/v3/projects => generated 401 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:49.825351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:49.840482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f78de9-de5e-443e-b637-2383b4a1a411 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.914406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.915162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.915569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.915929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.916850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.918868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.945763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1101/2183] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:49 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:49.952411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:49.965969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a4c25-cde7-43e6-b5d3-06527ec3aa62 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.971478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.972292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.972774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.973314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.974226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.976456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.989744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1083/2184] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:49.993706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.004780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023efeb3-487c-4ea4-896b-f1fe8e44dcd8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.020327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642170b-242e-4f6e-8d90-230de1e67082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.021149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642170b-242e-4f6e-8d90-230de1e67082 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.021444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642170b-242e-4f6e-8d90-230de1e67082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.021732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642170b-242e-4f6e-8d90-230de1e67082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.022488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642170b-242e-4f6e-8d90-230de1e67082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.031039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642170b-242e-4f6e-8d90-230de1e67082 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.044257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1102/2185] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:50.049186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.064029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cecca-8e7e-430f-a4d0-bf3122587c72 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.072707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.074020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.074483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.075061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] PATH_INFO: `/v3/projects/5d07c8e0faa24cddb67e7faa5136aa36/users/8569d72164d44a80be81c3265ef7d206/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.093796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d07c8e0faa24cddb67e7faa5136aa36, user_id=8569d72164d44a80be81c3265ef7d206, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.097664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.128956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1084/2186] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:50 2022] PUT /identity/v3/projects/5d07c8e0faa24cddb67e7faa5136aa36/users/8569d72164d44a80be81c3265ef7d206/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:50.129149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb74cc7-d2be-4072-b9a6-4eee3d6dbf4e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.129149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb74cc7-d2be-4072-b9a6-4eee3d6dbf4e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.129149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb74cc7-d2be-4072-b9a6-4eee3d6dbf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.163673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1eb74cc7-d2be-4072-b9a6-4eee3d6dbf4e None None] MFA Rules not processed for user `8569d72164d44a80be81c3265ef7d206`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:50.164961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1eb74cc7-d2be-4072-b9a6-4eee3d6dbf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:50.246006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1103/2187] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:50.252101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.317678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7c736-7543-4f3b-8dd4-2cac93f05eeb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.322408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.323074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.323361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.323643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.324355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.326312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.353118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1085/2188] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:50.357186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb74cc7-d2be-4072-b9a6-4eee3d6dbf4e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.369158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb74cc7-d2be-4072-b9a6-4eee3d6dbf4e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.394158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:50.428606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.429395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.429687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.429970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.430909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.433163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.453834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1104/2189] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:50.457814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.468213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc99b32-a85c-4b5c-ada5-3410fa017f1b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.473379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.474038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.474325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.474608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.475342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.476994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.488121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1086/2190] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:50.492679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.502650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a80fa-359b-4aca-a440-a80989e958d4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.507207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.508080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.508363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.508640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] PATH_INFO: `/v3/projects/45db3aae2aa6419e9e37ef9a2f1ddb23/users/36ef46ab95564c7684376ce6f402e433/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.523256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45db3aae2aa6419e9e37ef9a2f1ddb23, user_id=36ef46ab95564c7684376ce6f402e433, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.525969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.541716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1105/2191] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:50 2022] PUT /identity/v3/projects/45db3aae2aa6419e9e37ef9a2f1ddb23/users/36ef46ab95564c7684376ce6f402e433/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:50.545867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.557165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76c667-d93c-4697-bd26-ae6a8cb3d11f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.590083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:50.617607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f5a1-bc3a-4fbe-a428-397b25cb8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.618284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f5a1-bc3a-4fbe-a428-397b25cb8921 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.618572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f5a1-bc3a-4fbe-a428-397b25cb8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.618855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f5a1-bc3a-4fbe-a428-397b25cb8921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.619587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4f5a1-bc3a-4fbe-a428-397b25cb8921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.621243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4f5a1-bc3a-4fbe-a428-397b25cb8921 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.631154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1087/2192] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:50.635307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.645450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d42d7-6aed-4b1e-bf67-bcc5dbca1b36 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.649993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.650874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.651165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.651444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] PATH_INFO: `/v3/projects/45db3aae2aa6419e9e37ef9a2f1ddb23/users/36ef46ab95564c7684376ce6f402e433/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.653442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45db3aae2aa6419e9e37ef9a2f1ddb23, user_id=36ef46ab95564c7684376ce6f402e433, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.656120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.667575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1106/2193] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:50 2022] PUT /identity/v3/projects/45db3aae2aa6419e9e37ef9a2f1ddb23/users/36ef46ab95564c7684376ce6f402e433/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:50.679245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f675-af1e-49f0-bb1d-7c7afbc0bc9c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.679566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f675-af1e-49f0-bb1d-7c7afbc0bc9c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.679849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6f675-af1e-49f0-bb1d-7c7afbc0bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.705953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-65b6f675-af1e-49f0-bb1d-7c7afbc0bc9c None None] MFA Rules not processed for user `36ef46ab95564c7684376ce6f402e433`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:50.707155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-65b6f675-af1e-49f0-bb1d-7c7afbc0bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:50.782604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1088/2194] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:50.793615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.795316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:50.861471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b195-d1f8-4602-bdd3-443336f51508 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.865324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.866246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.866533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.866812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.876489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.877982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.889129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1107/2195] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:50.960247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6f675-af1e-49f0-bb1d-7c7afbc0bc9c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.970972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6f675-af1e-49f0-bb1d-7c7afbc0bc9c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.974702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d18b79-868e-49d9-b04a-e3b1bb4a44eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.975344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18b79-868e-49d9-b04a-e3b1bb4a44eb service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.975630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18b79-868e-49d9-b04a-e3b1bb4a44eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.975913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18b79-868e-49d9-b04a-e3b1bb4a44eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:51.048310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18b79-868e-49d9-b04a-e3b1bb4a44eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:51.048310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18b79-868e-49d9-b04a-e3b1bb4a44eb service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:51.050963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1089/2196] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:54.648318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:54.649947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:54.728205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2dc0-2297-4818-9942-34dbbd07bf9f service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:54.747915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:54.748960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:54.749252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:54.749533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] PATH_INFO: `/v3/users/57a9e1a3cc024c748ed0d94b9db598f1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:54.752072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a9e1a3cc024c748ed0d94b9db598f1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:54.754761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:54.781871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:54.810992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a9e1a3cc024c748ed0d94b9db598f1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:54.824878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a9e1a3cc024c748ed0d94b9db598f1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:54.832953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a9e1a3cc024c748ed0d94b9db598f1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:54.840072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a9e1a3cc024c748ed0d94b9db598f1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:54.840796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a9e1a3cc024c748ed0d94b9db598f1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:54.846909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1108/2197] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:54 2022] DELETE /identity/v3/users/57a9e1a3cc024c748ed0d94b9db598f1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:54.851433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:54.851955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:54.852128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:54.874009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:54.875906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:54.937539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:54.949638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1090/2198] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:54.958876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:54.960321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:55.020982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa407800-0811-4f46-b62a-8d406735cc4e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:55.024710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:55.025398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:55.025692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:55.025970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:55.036289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:55.037754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:55.048476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1109/2199] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:55.410977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:55.412433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:55.424943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f008c9-0d7e-43d7-aab6-7f6bf67bd658 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:55.429888 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:55.430785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:55.431189 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:55.431471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] PATH_INFO: `/v3/projects/7082c103be804645bf1f9115cfc1ac5b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:55.433196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7082c103be804645bf1f9115cfc1ac5b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:55.435115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:55.489537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7082c103be804645bf1f9115cfc1ac5b', 'request_id': 'req-329510b7-c58c-40f9-affb-198510e53b72'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.496304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7082c103be804645bf1f9115cfc1ac5b', 'request_id': 'req-329510b7-c58c-40f9-affb-198510e53b72'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.505490 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7082c103be804645bf1f9115cfc1ac5b', 'request_id': 'req-329510b7-c58c-40f9-affb-198510e53b72'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.520280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] The token cache is being invalidate because project 7082c103be804645bf1f9115cfc1ac5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:55.520578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.521267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.522992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1091/2200] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:55 2022] DELETE /identity/v3/projects/7082c103be804645bf1f9115cfc1ac5b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:55.527227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:55.540427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bb100-f14e-4c03-8d99-d73b1ba57c18 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:55.625890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:55.626955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:55.627335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:55.627543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] PATH_INFO: `/v3/users/22a7923c0c6646e3b4ffa6081be12eb8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:55.628895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a7923c0c6646e3b4ffa6081be12eb8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:55.631606 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:55.696161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:55.697817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a7923c0c6646e3b4ffa6081be12eb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.711093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a7923c0c6646e3b4ffa6081be12eb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.717718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a7923c0c6646e3b4ffa6081be12eb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.725094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a7923c0c6646e3b4ffa6081be12eb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.725716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccd7a9c9-6235-4e35-9225-fd402d1a18b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a7923c0c6646e3b4ffa6081be12eb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.731632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1110/2201] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:55 2022] DELETE /identity/v3/users/22a7923c0c6646e3b4ffa6081be12eb8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:56.072576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.074134 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.089988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329510b7-c58c-40f9-affb-198510e53b72 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.155146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.156558 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.156876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.157164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] PATH_INFO: `/v3/projects/4400bf21f5aa4050a88a6efb9a3d8110` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.158365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4400bf21f5aa4050a88a6efb9a3d8110)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.160300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.208067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4400bf21f5aa4050a88a6efb9a3d8110', 'request_id': 'req-31d69b4c-04f5-4bdc-b597-1dd21801b34c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.215156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4400bf21f5aa4050a88a6efb9a3d8110', 'request_id': 'req-31d69b4c-04f5-4bdc-b597-1dd21801b34c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.224096 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4400bf21f5aa4050a88a6efb9a3d8110', 'request_id': 'req-31d69b4c-04f5-4bdc-b597-1dd21801b34c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.236056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] The token cache is being invalidate because project 4400bf21f5aa4050a88a6efb9a3d8110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:56.236395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.237126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-31d69b4c-04f5-4bdc-b597-1dd21801b34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.238785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1092/2202] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:56 2022] DELETE /identity/v3/projects/4400bf21f5aa4050a88a6efb9a3d8110 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:56.243947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65bec1-e229-4013-83e6-1f6b89c76dac None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.244243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65bec1-e229-4013-83e6-1f6b89c76dac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.244529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65bec1-e229-4013-83e6-1f6b89c76dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.262535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed65bec1-e229-4013-83e6-1f6b89c76dac None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:56.263829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed65bec1-e229-4013-83e6-1f6b89c76dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.324938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1111/2203] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:56.391137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409a605-a3f9-45e7-bba0-d47a691731e5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.391436 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409a605-a3f9-45e7-bba0-d47a691731e5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.391727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409a605-a3f9-45e7-bba0-d47a691731e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.410927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7409a605-a3f9-45e7-bba0-d47a691731e5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:56.412180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7409a605-a3f9-45e7-bba0-d47a691731e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.420105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1093/2204] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:56.425121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65bec1-e229-4013-83e6-1f6b89c76dac None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.435295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65bec1-e229-4013-83e6-1f6b89c76dac None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.440037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.440727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.441047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.441331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.442063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:56.442379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.443990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.455721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1112/2205] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:56.460127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409a605-a3f9-45e7-bba0-d47a691731e5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.464958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:56.472284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409a605-a3f9-45e7-bba0-d47a691731e5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.479285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.480014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.480690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.481194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.482234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.485075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.519047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1094/2206] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:56.520285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.531489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ea819-af6e-4477-b74a-3854643d8369 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.590678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.591421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.591714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.592044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.592738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.595387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.616323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1113/2207] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:56.620482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.631095 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd584dd-d50c-4143-9d42-2138657b647a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.635898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.636567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.636893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.637243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.637916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.639516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.650580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1095/2208] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:56.662327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.665546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ceda1-8119-430b-88fc-4b9324edc4d7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.670667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22954ea5-519d-4048-9d8b-1b2c665ae243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.672698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22954ea5-519d-4048-9d8b-1b2c665ae243 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.672698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22954ea5-519d-4048-9d8b-1b2c665ae243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.672698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22954ea5-519d-4048-9d8b-1b2c665ae243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.673394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22954ea5-519d-4048-9d8b-1b2c665ae243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.675454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22954ea5-519d-4048-9d8b-1b2c665ae243 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.686461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1114/2209] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:56.690359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.702041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f0ee5-a8c3-49fd-af1f-13326359036b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.707621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.708645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.708987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.709275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] PATH_INFO: `/v3/projects/08246ed171a04f08ade0288570ae9d5a/users/dee73b614227486599454524a844d0d9/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.733824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08246ed171a04f08ade0288570ae9d5a, user_id=dee73b614227486599454524a844d0d9, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.737373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.751851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1096/2210] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:56 2022] PUT /identity/v3/projects/08246ed171a04f08ade0288570ae9d5a/users/dee73b614227486599454524a844d0d9/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:56.757051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.757866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.758300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.778099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:56.779306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.812744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:56.861457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1115/2211] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:56.871811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.875757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.953923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84637828-1f0c-4b9f-81d0-fd7d3a9c2b7a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.958361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572346d-0bfe-4136-a64e-fcb0f577a084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.959219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572346d-0bfe-4136-a64e-fcb0f577a084 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.959729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572346d-0bfe-4136-a64e-fcb0f577a084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.960073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572346d-0bfe-4136-a64e-fcb0f577a084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.971699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572346d-0bfe-4136-a64e-fcb0f577a084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.973823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572346d-0bfe-4136-a64e-fcb0f577a084 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.991170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1097/2212] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:57.315224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:57.316922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:57.331485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff828ad7-e351-41bb-aa42-dcd5386ad86c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:57.336853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:57.337729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:57.338237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:57.338523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] PATH_INFO: `/v3/users/8569d72164d44a80be81c3265ef7d206` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:57.339751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8569d72164d44a80be81c3265ef7d206)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:57.341744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:57.413991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8569d72164d44a80be81c3265ef7d206'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:57.456574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8569d72164d44a80be81c3265ef7d206'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:57.470293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8569d72164d44a80be81c3265ef7d206'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:57.486152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8569d72164d44a80be81c3265ef7d206'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:57.488628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8569d72164d44a80be81c3265ef7d206'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:57.499475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1116/2213] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:57 2022] DELETE /identity/v3/users/8569d72164d44a80be81c3265ef7d206 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:57.504125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e60b1-3139-412b-847e-7d0e8ed6856f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:57.504621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e60b1-3139-412b-847e-7d0e8ed6856f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:57.504738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e60b1-3139-412b-847e-7d0e8ed6856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:57.523521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e24e60b1-3139-412b-847e-7d0e8ed6856f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:57.524743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e24e60b1-3139-412b-847e-7d0e8ed6856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:57.590084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1098/2214] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:57.602217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:57.604411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:57.670100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be215a8-d41f-4a45-85bc-f1cd2e9b9ab7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:57.674463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:57.675193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:57.675480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:57.675762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:57.685974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:57.687482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:57.697660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1117/2215] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:57.946907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:57.947091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:57.947447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:57.985679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] MFA Rules not processed for user `dee73b614227486599454524a844d0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:57.987132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:58.042512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:58.058219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:58.060153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:58.075902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e0c1-2b8b-46d5-8f43-07fe7fcb1eb1 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:58.083407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:58.084517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:58.085058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:58.085558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] PATH_INFO: `/v3/projects/5d07c8e0faa24cddb67e7faa5136aa36` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:58.086921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d07c8e0faa24cddb67e7faa5136aa36)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:58.089949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:58.092644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1099/2216] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:58.107332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:58.109232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:58.152356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:58.163983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d07c8e0faa24cddb67e7faa5136aa36', 'request_id': 'req-8c1cf972-be4f-4e8c-ae25-a8243038cc50'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.175828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d07c8e0faa24cddb67e7faa5136aa36', 'request_id': 'req-8c1cf972-be4f-4e8c-ae25-a8243038cc50'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.201555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d07c8e0faa24cddb67e7faa5136aa36', 'request_id': 'req-8c1cf972-be4f-4e8c-ae25-a8243038cc50'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.226970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] The token cache is being invalidate because project 5d07c8e0faa24cddb67e7faa5136aa36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:58.227269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.228700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f13ea4-73fc-4171-8fd4-94624aa98734 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:58.229672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.231901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1118/2217] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:58 2022] DELETE /identity/v3/projects/5d07c8e0faa24cddb67e7faa5136aa36 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:58.236488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:58.245634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:58.296011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:58.297815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:58.298111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:58.298394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:58.301055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:58.327655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cf972-be4f-4e8c-ae25-a8243038cc50 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:58.333240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:58.334129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:58.334429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:58.334698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] PATH_INFO: `/v3/users/36ef46ab95564c7684376ce6f402e433` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:58.335912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ef46ab95564c7684376ce6f402e433)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:58.337961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:58.375919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:58.377650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:58.389027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1100/2218] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:58.397074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ef46ab95564c7684376ce6f402e433'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.411496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ef46ab95564c7684376ce6f402e433'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.419474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ef46ab95564c7684376ce6f402e433'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.428782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ef46ab95564c7684376ce6f402e433'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.429746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7483ec2d-8c15-4b1e-8a40-a853c77f3f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ef46ab95564c7684376ce6f402e433'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.441664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1119/2219] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:58 2022] DELETE /identity/v3/users/36ef46ab95564c7684376ce6f402e433 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:58.781872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:58.794485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9d70-0d25-40fb-bff1-6d53add38ef1 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:58.851202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:58.866016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:58.866886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:58.867173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:58.867481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] PATH_INFO: `/v3/projects/45db3aae2aa6419e9e37ef9a2f1ddb23` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:58.868749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45db3aae2aa6419e9e37ef9a2f1ddb23)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:58.870768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:58.922859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45db3aae2aa6419e9e37ef9a2f1ddb23', 'request_id': 'req-24cfebf0-cb67-4779-abc1-7c17b81c28f3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.929364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45db3aae2aa6419e9e37ef9a2f1ddb23', 'request_id': 'req-24cfebf0-cb67-4779-abc1-7c17b81c28f3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.937265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45db3aae2aa6419e9e37ef9a2f1ddb23', 'request_id': 'req-24cfebf0-cb67-4779-abc1-7c17b81c28f3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.949182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] The token cache is being invalidate because project 45db3aae2aa6419e9e37ef9a2f1ddb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:58.949473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.950109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24cfebf0-cb67-4779-abc1-7c17b81c28f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:58.951646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1101/2220] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:58 2022] DELETE /identity/v3/projects/45db3aae2aa6419e9e37ef9a2f1ddb23 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:58.956928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373248f-cdce-48f5-bc1a-7a84119409cf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:58.957228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373248f-cdce-48f5-bc1a-7a84119409cf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:58.957510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373248f-cdce-48f5-bc1a-7a84119409cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:58.976136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2373248f-cdce-48f5-bc1a-7a84119409cf None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:58.977383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2373248f-cdce-48f5-bc1a-7a84119409cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:59.020595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:59.040445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1120/2221] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:59.048427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881431af-7750-4a35-adc1-36f593e0f0d3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.048715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881431af-7750-4a35-adc1-36f593e0f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.049036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881431af-7750-4a35-adc1-36f593e0f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.067197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-881431af-7750-4a35-adc1-36f593e0f0d3 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:59.068422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-881431af-7750-4a35-adc1-36f593e0f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:59.076435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1102/2222] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:59.081500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373248f-cdce-48f5-bc1a-7a84119409cf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.091253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373248f-cdce-48f5-bc1a-7a84119409cf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.096558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.097262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.097554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.097839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.098574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:59.098885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.100505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.112671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1121/2223] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:59.117232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881431af-7750-4a35-adc1-36f593e0f0d3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.128725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881431af-7750-4a35-adc1-36f593e0f0d3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.134152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.134818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.135108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.135438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.136922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.138849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.166520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1103/2224] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:59 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:59.170635 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.180564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86f97-3730-447c-ac57-5f2899e1a817 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.237225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.237887 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.238174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.238456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.239137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.241354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.265735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1122/2225] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:59 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:59.267192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.277703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c24e3-c99a-48a1-b988-35728913c7d9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.284039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.284714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.285069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.285296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.286030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.288022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.305974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1104/2226] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:59.307206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.317505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e8e7-50c9-4d2f-9e83-dc052c37bbf4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.322347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d7a2e-94a7-4eb2-ba02-9bba98e9c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.323010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7a2e-94a7-4eb2-ba02-9bba98e9c863 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.323327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7a2e-94a7-4eb2-ba02-9bba98e9c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.323608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7a2e-94a7-4eb2-ba02-9bba98e9c863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.324338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d7a2e-94a7-4eb2-ba02-9bba98e9c863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.325994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d7a2e-94a7-4eb2-ba02-9bba98e9c863 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.336480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1123/2227] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:59.340555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.351136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298d024-86f4-4644-b903-c33cfc465c53 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.355707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.356576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.356896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.357180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] PATH_INFO: `/v3/projects/f808b445997e4a8ba87cb31af0c601df/users/233dda4291ff4d70979441ea64cc9dd8/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.371895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f808b445997e4a8ba87cb31af0c601df, user_id=233dda4291ff4d70979441ea64cc9dd8, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.375191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.387921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1105/2228] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:59 2022] PUT /identity/v3/projects/f808b445997e4a8ba87cb31af0c601df/users/233dda4291ff4d70979441ea64cc9dd8/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:59.398912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca550a3-b4a6-46ad-a9cb-4d0c78bafd2a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.399207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca550a3-b4a6-46ad-a9cb-4d0c78bafd2a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.399495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca550a3-b4a6-46ad-a9cb-4d0c78bafd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.425472 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aca550a3-b4a6-46ad-a9cb-4d0c78bafd2a None None] MFA Rules not processed for user `233dda4291ff4d70979441ea64cc9dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:59.426674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aca550a3-b4a6-46ad-a9cb-4d0c78bafd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:59.492769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1124/2229] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:59.497306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.557729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439ef03-843b-4584-aaad-5a80129fdfff admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.562891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50304059-199a-4406-9132-345850364082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.563673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50304059-199a-4406-9132-345850364082 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.563961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50304059-199a-4406-9132-345850364082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.564258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50304059-199a-4406-9132-345850364082 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.564963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50304059-199a-4406-9132-345850364082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.566878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50304059-199a-4406-9132-345850364082 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.586981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:59.594649 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1106/2230] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:59 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:59.598397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca550a3-b4a6-46ad-a9cb-4d0c78bafd2a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.608885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca550a3-b4a6-46ad-a9cb-4d0c78bafd2a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.649034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:59.666124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.666800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.667087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.667368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.668067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.670028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.690066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1125/2231] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:59 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:59.694184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50304059-199a-4406-9132-345850364082 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.705308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50304059-199a-4406-9132-345850364082 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.709983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.710635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.710919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.711197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.711920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.713572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.724953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1107/2232] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:59.728995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.739298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72df83e-316e-41d5-867a-a073df17d24a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.744134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.745065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.745352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.745634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] PATH_INFO: `/v3/projects/e7daf4ce3a1e4831adfdb71550b23958/users/13ba1cb7b8b44d08b43f64fef2409313/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.760698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7daf4ce3a1e4831adfdb71550b23958, user_id=13ba1cb7b8b44d08b43f64fef2409313, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.763377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.777609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1126/2233] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:59 2022] PUT /identity/v3/projects/e7daf4ce3a1e4831adfdb71550b23958/users/13ba1cb7b8b44d08b43f64fef2409313/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:59.782337 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.792777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46739c2-c587-4bc3-be85-5343c4cf61cf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.850442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a26f19-cc7a-46ae-973e-f33ac376a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.851113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a26f19-cc7a-46ae-973e-f33ac376a90b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.851397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a26f19-cc7a-46ae-973e-f33ac376a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.851680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a26f19-cc7a-46ae-973e-f33ac376a90b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.852409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a26f19-cc7a-46ae-973e-f33ac376a90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.854061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a26f19-cc7a-46ae-973e-f33ac376a90b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.869265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1108/2234] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:59.870488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:59.881989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6e9fa-c4de-4bf9-ba8e-e96aed95f5ed admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:59.886761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:59.887650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.887936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.888220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] PATH_INFO: `/v3/projects/e7daf4ce3a1e4831adfdb71550b23958/users/13ba1cb7b8b44d08b43f64fef2409313/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.890256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7daf4ce3a1e4831adfdb71550b23958, user_id=13ba1cb7b8b44d08b43f64fef2409313, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:59.893257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:59.903451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1127/2235] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:59 2022] PUT /identity/v3/projects/e7daf4ce3a1e4831adfdb71550b23958/users/13ba1cb7b8b44d08b43f64fef2409313/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:59.914878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7088-7d36-481a-a514-d7a841bb539f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:59.915171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7088-7d36-481a-a514-d7a841bb539f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:59.915452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7088-7d36-481a-a514-d7a841bb539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:59.942831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-47fb7088-7d36-481a-a514-d7a841bb539f None None] MFA Rules not processed for user `13ba1cb7b8b44d08b43f64fef2409313`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:59.944086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-47fb7088-7d36-481a-a514-d7a841bb539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:00.011701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1109/2236] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:19:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:00.022814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:00.024780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:00.084858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c09d-6d4d-4815-b4a4-8c4bf93c2f75 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:00.089147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd705f00-74c4-4985-85ab-881c899096dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:00.089528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705f00-74c4-4985-85ab-881c899096dc service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:00.089812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705f00-74c4-4985-85ab-881c899096dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:00.090093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705f00-74c4-4985-85ab-881c899096dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:00.104173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd705f00-74c4-4985-85ab-881c899096dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:00.105662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd705f00-74c4-4985-85ab-881c899096dc service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:00.115741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1128/2237] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:00.704961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb7088-7d36-481a-a514-d7a841bb539f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:00.765056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb7088-7d36-481a-a514-d7a841bb539f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:00.769885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:00.770761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:00.771050 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:00.771401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] PATH_INFO: `/v3/users/233dda4291ff4d70979441ea64cc9dd8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:00.772631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] RBAC: Authorizing `identity:delete_user(user_id=233dda4291ff4d70979441ea64cc9dd8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:00.774644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:00.788082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:00.836912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233dda4291ff4d70979441ea64cc9dd8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:00.855954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233dda4291ff4d70979441ea64cc9dd8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:00.857413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233dda4291ff4d70979441ea64cc9dd8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:00.870830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233dda4291ff4d70979441ea64cc9dd8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:00.881014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233dda4291ff4d70979441ea64cc9dd8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:00.890555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1110/2238] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:00 2022] DELETE /identity/v3/users/233dda4291ff4d70979441ea64cc9dd8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:00.895806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:00.896108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:00.896637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:00.919293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:00.920504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:00.987103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1129/2239] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:00.996982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:00.998415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:01.056229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cb2d3-b194-45d3-8d2e-c5e93532133e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:01.059873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:01.060520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:01.060806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:01.061114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:01.070167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:01.071603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:01.081225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1111/2240] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:01.450626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:01.453902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:01.472581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d98e-6cb5-491f-9d88-00bdfaf092c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:01.478801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:01.479679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:01.479974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:01.480258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] PATH_INFO: `/v3/projects/f808b445997e4a8ba87cb31af0c601df` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:01.481668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f808b445997e4a8ba87cb31af0c601df)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:01.483607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:01.523784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:01.538878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f808b445997e4a8ba87cb31af0c601df', 'request_id': 'req-2cb68e83-cefc-4e57-b382-c33729567aa0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.547391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f808b445997e4a8ba87cb31af0c601df', 'request_id': 'req-2cb68e83-cefc-4e57-b382-c33729567aa0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.555339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f808b445997e4a8ba87cb31af0c601df', 'request_id': 'req-2cb68e83-cefc-4e57-b382-c33729567aa0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.568094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] The token cache is being invalidate because project f808b445997e4a8ba87cb31af0c601df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:01.568386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.569076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2cb68e83-cefc-4e57-b382-c33729567aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.571127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1130/2241] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:01 2022] DELETE /identity/v3/projects/f808b445997e4a8ba87cb31af0c601df => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:01.574747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:01.588290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f0ce-b5ce-479e-adad-8c18bf00b2fc service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:01.651911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:01.652725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:01.653047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:01.653327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] PATH_INFO: `/v3/users/13ba1cb7b8b44d08b43f64fef2409313` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:01.654613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ba1cb7b8b44d08b43f64fef2409313)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:01.657174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:01.703226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:01.715132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ba1cb7b8b44d08b43f64fef2409313'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.728320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ba1cb7b8b44d08b43f64fef2409313'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.729089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ba1cb7b8b44d08b43f64fef2409313'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.738351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ba1cb7b8b44d08b43f64fef2409313'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.747769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ba1cb7b8b44d08b43f64fef2409313'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:01.755685 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1112/2242] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:01 2022] DELETE /identity/v3/users/13ba1cb7b8b44d08b43f64fef2409313 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:01.992285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a732-6d9a-44c8-82a9-29773df08853 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:01.992591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a732-6d9a-44c8-82a9-29773df08853 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:01.992894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a732-6d9a-44c8-82a9-29773df08853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:02.031753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7f5a732-6d9a-44c8-82a9-29773df08853 None None] MFA Rules not processed for user `dee73b614227486599454524a844d0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:02.033686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7f5a732-6d9a-44c8-82a9-29773df08853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:02.113479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1131/2243] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:02.424616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:02.426277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:02.540369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb80ed1-60ca-4638-8321-74db0ad56d15 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:02.545801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:02.547493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:02.547762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:02.548048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] PATH_INFO: `/v3/projects/e7daf4ce3a1e4831adfdb71550b23958` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:02.549350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7daf4ce3a1e4831adfdb71550b23958)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:02.551354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:02.623726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7daf4ce3a1e4831adfdb71550b23958', 'request_id': 'req-e588918c-13df-48b5-89b8-db23fd30ec89'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:02.631406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7daf4ce3a1e4831adfdb71550b23958', 'request_id': 'req-e588918c-13df-48b5-89b8-db23fd30ec89'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:02.638809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7daf4ce3a1e4831adfdb71550b23958', 'request_id': 'req-e588918c-13df-48b5-89b8-db23fd30ec89'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:02.649228 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] The token cache is being invalidate because project e7daf4ce3a1e4831adfdb71550b23958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:02.649518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:02.650142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e588918c-13df-48b5-89b8-db23fd30ec89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:02.651981 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1113/2244] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:02 2022] DELETE /identity/v3/projects/e7daf4ce3a1e4831adfdb71550b23958 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:02.658143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f09bd-2199-44a0-81d5-d9558a3476cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:02.658628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f09bd-2199-44a0-81d5-d9558a3476cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:02.658819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f09bd-2199-44a0-81d5-d9558a3476cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:02.679212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8c8f09bd-2199-44a0-81d5-d9558a3476cc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:02.680471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c8f09bd-2199-44a0-81d5-d9558a3476cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:02.758529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1132/2245] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:02.760376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867e32-2bb4-4ead-ad63-358cac0f7c51 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:02.760674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867e32-2bb4-4ead-ad63-358cac0f7c51 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:02.760991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867e32-2bb4-4ead-ad63-358cac0f7c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:02.780528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0e867e32-2bb4-4ead-ad63-358cac0f7c51 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:02.782377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e867e32-2bb4-4ead-ad63-358cac0f7c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:02.791159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1114/2246] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:02.795379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f09bd-2199-44a0-81d5-d9558a3476cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:02.805390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f09bd-2199-44a0-81d5-d9558a3476cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:02.810029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:02.810687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:02.810980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:02.811265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:02.812057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:02.812369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:02.814021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:02.826788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1133/2247] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:20:02.831646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e867e32-2bb4-4ead-ad63-358cac0f7c51 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:02.842774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e867e32-2bb4-4ead-ad63-358cac0f7c51 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:02.848489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:02.849277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:02.849635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:02.849994 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:02.850760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:02.852775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:02.887804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1115/2248] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:02 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:02.892690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:02.903313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71167510-6677-45f9-a74a-159300a59a86 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:02.952984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:02.964673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:02.965380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:02.965668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:02.965949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:02.966636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:02.969304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:02.991880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1134/2249] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:02 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:02.996168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:03.007127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af82898-7caa-4374-a1f8-66496fe83465 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:03.017504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:03.018557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:03.018966 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:03.019334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:03.020138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:03.022101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:03.039598 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1116/2250] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:03.040211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:03.054561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df951fd-fc18-4002-a02c-7e2c03f6f7eb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:03.059568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85515789-86a5-444f-96ee-6c9a8241ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:03.060342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515789-86a5-444f-96ee-6c9a8241ef51 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:03.060636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515789-86a5-444f-96ee-6c9a8241ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:03.060954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515789-86a5-444f-96ee-6c9a8241ef51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:03.061914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85515789-86a5-444f-96ee-6c9a8241ef51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:03.063800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85515789-86a5-444f-96ee-6c9a8241ef51 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:03.078608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1135/2251] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:03.086967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:03.092880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:03.100776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c085b5-dae9-46b0-a25f-4516de2d5465 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:03.106651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:03.108340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:03.109209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:03.110013 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] PATH_INFO: `/v3/projects/53251dddae4747a1aaea632a36cd8dd7/users/95ea05beeec34d138cf33fc907420c65/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:03.128125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53251dddae4747a1aaea632a36cd8dd7, user_id=95ea05beeec34d138cf33fc907420c65, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:03.130943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:03.149902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1117/2252] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:03 2022] PUT /identity/v3/projects/53251dddae4747a1aaea632a36cd8dd7/users/95ea05beeec34d138cf33fc907420c65/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:03.160774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:03.161132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:03.161436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:03.208856 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] MFA Rules not processed for user `95ea05beeec34d138cf33fc907420c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:03.210009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:03.309722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1136/2253] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:03.322051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:03.324296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:03.395139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0cfab-e4f8-4c82-be3d-b0f9c4317a74 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:03.398902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401dd39-0839-4c39-aed3-1defff748439 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:03.399557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401dd39-0839-4c39-aed3-1defff748439 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:03.399847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401dd39-0839-4c39-aed3-1defff748439 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:03.400131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401dd39-0839-4c39-aed3-1defff748439 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:03.410706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401dd39-0839-4c39-aed3-1defff748439 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:03.412488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401dd39-0839-4c39-aed3-1defff748439 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:03.423217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1118/2254] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:07.295699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:07.297316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:07.370517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23915e7-7514-4516-8f6e-36bfb5a8b5d8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:07.376101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:07.377188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:07.377804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:07.378440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] PATH_INFO: `/v3/users/b02006761da04411958b03f59fcd022d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:07.379808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02006761da04411958b03f59fcd022d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:07.381783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:07.446899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02006761da04411958b03f59fcd022d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:07.463052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:07.464570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02006761da04411958b03f59fcd022d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:07.475574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02006761da04411958b03f59fcd022d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:07.484233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02006761da04411958b03f59fcd022d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:07.484987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02006761da04411958b03f59fcd022d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:07.492879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1137/2255] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:07 2022] DELETE /identity/v3/users/b02006761da04411958b03f59fcd022d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:07.497402 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:07.498755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:07.504409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:07.526625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:07.527835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:07.599118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1119/2256] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:07.610726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:07.612407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:07.690615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821a41-ceab-4ac7-a253-b845e26654c8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:07.695317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f610d2-3e2f-4038-af84-09c63ba995b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:07.695933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f610d2-3e2f-4038-af84-09c63ba995b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:07.696249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f610d2-3e2f-4038-af84-09c63ba995b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:07.696536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f610d2-3e2f-4038-af84-09c63ba995b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:07.707800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f610d2-3e2f-4038-af84-09c63ba995b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:07.709336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f610d2-3e2f-4038-af84-09c63ba995b0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:07.732346 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1138/2257] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:08.146414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:08.149086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:08.161669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30875f-f950-4a95-acbf-46eb11c35a38 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:08.166945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:08.167992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:08.168303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:08.168552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] PATH_INFO: `/v3/users/55c6e6d7ad704d1d89701dadda9b9f5a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:08.169788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c6e6d7ad704d1d89701dadda9b9f5a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:08.172334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:08.241643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c6e6d7ad704d1d89701dadda9b9f5a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.258359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c6e6d7ad704d1d89701dadda9b9f5a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.259172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c6e6d7ad704d1d89701dadda9b9f5a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.268091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c6e6d7ad704d1d89701dadda9b9f5a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.274322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:08.276509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c6e6d7ad704d1d89701dadda9b9f5a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.285273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1120/2258] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:08 2022] DELETE /identity/v3/users/55c6e6d7ad704d1d89701dadda9b9f5a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:08.290594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:08.290994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:08.291371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:08.310760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:08.312786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:08.348692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:08.357410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:08.387102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1139/2259] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:08.397019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:08.398550 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:08.431040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06bddd-3f3d-4625-9545-03e30cf4d1fe admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:08.438351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:08.439268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:08.439530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:08.439816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] PATH_INFO: `/v3/projects/0e46d376457f45fb831df07e9bd60b58` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:08.441485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e46d376457f45fb831df07e9bd60b58)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:08.444617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:08.469867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8003-4a51-44d0-b65a-dbf32481286f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:08.473722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:08.474402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:08.474697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:08.475012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:08.485482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:08.486930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:08.496061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e46d376457f45fb831df07e9bd60b58', 'request_id': 'req-c5002485-c739-4912-a88f-10a514461edf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.496785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1140/2260] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:20:08.503791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e46d376457f45fb831df07e9bd60b58', 'request_id': 'req-c5002485-c739-4912-a88f-10a514461edf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.511586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e46d376457f45fb831df07e9bd60b58', 'request_id': 'req-c5002485-c739-4912-a88f-10a514461edf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.522829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] The token cache is being invalidate because project 0e46d376457f45fb831df07e9bd60b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:08.523121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.523776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.525686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1121/2261] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:08 2022] DELETE /identity/v3/projects/0e46d376457f45fb831df07e9bd60b58 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:08.817594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:08.819505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:08.840762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13253d5-7fb5-41c8-8a3c-da52a6d3a1cf service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:08.880174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:08.915721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:08.916589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:08.916908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:08.917191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] PATH_INFO: `/v3/projects/51630f0a37134b2995adb145444a9448` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:08.918371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51630f0a37134b2995adb145444a9448)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:08.920290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:08.965964 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51630f0a37134b2995adb145444a9448', 'request_id': 'req-81b097df-2000-4c0a-91c3-5226c2efb014'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.974230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51630f0a37134b2995adb145444a9448', 'request_id': 'req-81b097df-2000-4c0a-91c3-5226c2efb014'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.980848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51630f0a37134b2995adb145444a9448', 'request_id': 'req-81b097df-2000-4c0a-91c3-5226c2efb014'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.992430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] The token cache is being invalidate because project 51630f0a37134b2995adb145444a9448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:08.992722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.993434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:08.998069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1141/2262] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:08 2022] DELETE /identity/v3/projects/51630f0a37134b2995adb145444a9448 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:08.999269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:09.000937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:09.018349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5002485-c739-4912-a88f-10a514461edf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:09.078171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:09.079014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.079286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.079568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] PATH_INFO: `/v3/users/a35aa5ba664c445b9a8230a648b8477a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.081042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35aa5ba664c445b9a8230a648b8477a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:09.084484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:09.118595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:09.142380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35aa5ba664c445b9a8230a648b8477a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.154284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35aa5ba664c445b9a8230a648b8477a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.154960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35aa5ba664c445b9a8230a648b8477a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.163089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35aa5ba664c445b9a8230a648b8477a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.171152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d6e27f96-7b45-4776-8984-127f009d9b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35aa5ba664c445b9a8230a648b8477a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.177805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1122/2263] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:08 2022] DELETE /identity/v3/users/a35aa5ba664c445b9a8230a648b8477a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:09.467363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:09.469666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:09.484768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b097df-2000-4c0a-91c3-5226c2efb014 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:09.549983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:09.550966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.551161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.551410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] PATH_INFO: `/v3/projects/83cd586afe6f40c98d5117edbdb9a4b8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.552603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cd586afe6f40c98d5117edbdb9a4b8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:09.554556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:09.603336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cd586afe6f40c98d5117edbdb9a4b8', 'request_id': 'req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.610583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cd586afe6f40c98d5117edbdb9a4b8', 'request_id': 'req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.612723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:09.617763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cd586afe6f40c98d5117edbdb9a4b8', 'request_id': 'req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.630489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] The token cache is being invalidate because project 83cd586afe6f40c98d5117edbdb9a4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:09.630782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.631400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d8d107e-ba91-4059-a7a5-f3f2f692ad22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:09.632978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1142/2264] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:09 2022] DELETE /identity/v3/projects/83cd586afe6f40c98d5117edbdb9a4b8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:09.639043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3116942-f879-448c-b784-35e6267ccf83 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.639501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3116942-f879-448c-b784-35e6267ccf83 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.639661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3116942-f879-448c-b784-35e6267ccf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.657749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b3116942-f879-448c-b784-35e6267ccf83 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:09.658965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b3116942-f879-448c-b784-35e6267ccf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:09.721899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1123/2265] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:09.729564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afca737-33cd-41d4-9f9e-a04ce2b4dbca None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.729857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afca737-33cd-41d4-9f9e-a04ce2b4dbca None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.730138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afca737-33cd-41d4-9f9e-a04ce2b4dbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.748605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5afca737-33cd-41d4-9f9e-a04ce2b4dbca None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:09.750464 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5afca737-33cd-41d4-9f9e-a04ce2b4dbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:09.758295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1143/2266] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:09.762406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3116942-f879-448c-b784-35e6267ccf83 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:09.772236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3116942-f879-448c-b784-35e6267ccf83 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:09.776874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:09.777522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.777808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.778089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.778814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:09.779124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:09.780868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:09.792410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1124/2267] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:20:09.797206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afca737-33cd-41d4-9f9e-a04ce2b4dbca None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:09.807654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afca737-33cd-41d4-9f9e-a04ce2b4dbca None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:09.813328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:09.814005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.814290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.814570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.815271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:09.817218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:09.843722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1144/2268] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:09 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:09.847787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:09.857955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e05bd-dbb1-4160-9f9e-ceff7a261ccb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:09.915914 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:09.916579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.916891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.917176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.917856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:09.919785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:09.939152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1125/2269] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:09 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:09.943204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:09.954572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f1cfb-8d29-4352-a876-80de4c97fae2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:09.960365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:09.961160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.961501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.961794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.962546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:09.964325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:09.976428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1145/2270] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:09.980528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:09.991718 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b9a7b-c5ef-4710-9a38-f80cdb199f3e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:09.996378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d9c2d-0f9b-4663-a420-f8cccf8877c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:09.997062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9c2d-0f9b-4663-a420-f8cccf8877c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.997356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9c2d-0f9b-4663-a420-f8cccf8877c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.997638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9c2d-0f9b-4663-a420-f8cccf8877c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.998364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d9c2d-0f9b-4663-a420-f8cccf8877c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:09.999969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d9c2d-0f9b-4663-a420-f8cccf8877c8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.010142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1126/2271] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:10.014236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.024210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9954a-b172-4608-a6ee-515f887db508 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.028891 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.029783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.030065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.030347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] PATH_INFO: `/v3/projects/fe1ede26bdec461ea142d20b0a998c69/users/2c0ecfa23b6b4a208fb4bb5011ee10be/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.045374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1ede26bdec461ea142d20b0a998c69, user_id=2c0ecfa23b6b4a208fb4bb5011ee10be, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.048711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.061485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1146/2272] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:10 2022] PUT /identity/v3/projects/fe1ede26bdec461ea142d20b0a998c69/users/2c0ecfa23b6b4a208fb4bb5011ee10be/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:10.071839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536576-92ba-40ac-9c53-979b7cefc291 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.072132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536576-92ba-40ac-9c53-979b7cefc291 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.072415 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536576-92ba-40ac-9c53-979b7cefc291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.091526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:10.109353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-02536576-92ba-40ac-9c53-979b7cefc291 None None] MFA Rules not processed for user `2c0ecfa23b6b4a208fb4bb5011ee10be`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:10.111173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-02536576-92ba-40ac-9c53-979b7cefc291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:10.192004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1127/2273] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:10.196444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.268306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e64515-49aa-4795-a658-f5b4d5270d87 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.275099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.275777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.276073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.276551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.277103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.279257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.311644 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1147/2274] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:10 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:10.316330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536576-92ba-40ac-9c53-979b7cefc291 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.326957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536576-92ba-40ac-9c53-979b7cefc291 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.388351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.388943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.389233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.389516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.390206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.392165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.411427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1128/2275] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:10 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:10.415395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.426281 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44f2d-9e39-428e-bd88-c3fa48c35fbd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.430788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.431438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.431752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.432029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.432950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.434782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.447674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1148/2276] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:10.451786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.461815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36df96-7b77-444f-b34e-763576c68788 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.466638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.467518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.467804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.468085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] PATH_INFO: `/v3/projects/8089874e6d3240cd8ebaec39308a139b/users/5fb9d01f01ec40a0a8647598067935a3/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.488038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8089874e6d3240cd8ebaec39308a139b, user_id=5fb9d01f01ec40a0a8647598067935a3, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.491404 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.506039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1129/2277] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:10 2022] PUT /identity/v3/projects/8089874e6d3240cd8ebaec39308a139b/users/5fb9d01f01ec40a0a8647598067935a3/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:10.510075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.520352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f56bb-36e0-4863-8c26-93beb12ab72b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.571513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:10.578557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ea25-b6e7-46db-8a6b-8512ad924383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.579371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ea25-b6e7-46db-8a6b-8512ad924383 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.579672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ea25-b6e7-46db-8a6b-8512ad924383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.579944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ea25-b6e7-46db-8a6b-8512ad924383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.580686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ea25-b6e7-46db-8a6b-8512ad924383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.582441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ea25-b6e7-46db-8a6b-8512ad924383 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.594694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1149/2278] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:10.598483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.610326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbcb3-a6d1-4e01-ab20-c48e25853e28 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.615081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.616229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.616519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.616799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] PATH_INFO: `/v3/projects/8089874e6d3240cd8ebaec39308a139b/users/5fb9d01f01ec40a0a8647598067935a3/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.618867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8089874e6d3240cd8ebaec39308a139b, user_id=5fb9d01f01ec40a0a8647598067935a3, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.621603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.636499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1130/2279] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:10 2022] PUT /identity/v3/projects/8089874e6d3240cd8ebaec39308a139b/users/5fb9d01f01ec40a0a8647598067935a3/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:10.648584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a78ab2-6873-4a61-a4df-5e03a98be2de None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.648782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a78ab2-6873-4a61-a4df-5e03a98be2de None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.649129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a78ab2-6873-4a61-a4df-5e03a98be2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.680452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-18a78ab2-6873-4a61-a4df-5e03a98be2de None None] MFA Rules not processed for user `5fb9d01f01ec40a0a8647598067935a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:10.681717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-18a78ab2-6873-4a61-a4df-5e03a98be2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:10.751547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1150/2280] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:10.763782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.766639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:10.824457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562e2e-8a63-4fec-ae66-ebf0d5c82b64 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.828151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.828797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.829116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.829399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:10.835437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:10.840302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:10.842640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:10.856401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1131/2281] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:10.933379 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a78ab2-6873-4a61-a4df-5e03a98be2de None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:10.943177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a78ab2-6873-4a61-a4df-5e03a98be2de None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:10.946768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feedad7-c32e-42d6-984c-7acd594d6665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:10.947407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feedad7-c32e-42d6-984c-7acd594d6665 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:10.947698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feedad7-c32e-42d6-984c-7acd594d6665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:10.947987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feedad7-c32e-42d6-984c-7acd594d6665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:11.009865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feedad7-c32e-42d6-984c-7acd594d6665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:11.011311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feedad7-c32e-42d6-984c-7acd594d6665 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:11.020907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1151/2282] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:15.822793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:15.892735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9a0f-fcef-4cfa-9c5b-fbc36811b023 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:15.897399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:15.898272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:15.898557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:15.898839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] PATH_INFO: `/v3/users/2c0ecfa23b6b4a208fb4bb5011ee10be` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:15.900154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0ecfa23b6b4a208fb4bb5011ee10be)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:15.902124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:15.947428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0ecfa23b6b4a208fb4bb5011ee10be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:15.959062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0ecfa23b6b4a208fb4bb5011ee10be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:15.959790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0ecfa23b6b4a208fb4bb5011ee10be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:15.966967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0ecfa23b6b4a208fb4bb5011ee10be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:15.974825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0ecfa23b6b4a208fb4bb5011ee10be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:15.980717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1132/2283] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:15 2022] DELETE /identity/v3/users/2c0ecfa23b6b4a208fb4bb5011ee10be => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:15.985193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:15.985725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:15.985854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:16.005229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:16.006956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:16.086439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1152/2284] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:16.093073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:16.094662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:16.155886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376d498-204e-4e12-a0cc-3dbebec4dd4d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:16.160029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:16.160669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:16.160997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:16.161274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:16.170211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:16.171651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:16.181879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1133/2285] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:16.469309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:16.471442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:16.486618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068af3f-6614-4a85-8a69-167ea773c692 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:16.493854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:16.494900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:16.495202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:16.495474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] PATH_INFO: `/v3/projects/fe1ede26bdec461ea142d20b0a998c69` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:16.496762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1ede26bdec461ea142d20b0a998c69)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:16.498894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:16.515686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:16.566150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1ede26bdec461ea142d20b0a998c69', 'request_id': 'req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.578098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1ede26bdec461ea142d20b0a998c69', 'request_id': 'req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.586556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1ede26bdec461ea142d20b0a998c69', 'request_id': 'req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.619971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] The token cache is being invalidate because project fe1ede26bdec461ea142d20b0a998c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:16.620274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.623439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.626278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1153/2286] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:16 2022] DELETE /identity/v3/projects/fe1ede26bdec461ea142d20b0a998c69 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:16.631930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:16.646174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742f069-b706-4e35-9b15-47a04a1029fc service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:16.690380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:16.754700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:16.755873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:16.756169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:16.756470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] PATH_INFO: `/v3/users/5fb9d01f01ec40a0a8647598067935a3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:16.757962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb9d01f01ec40a0a8647598067935a3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:16.760987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:16.824460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb9d01f01ec40a0a8647598067935a3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.841770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb9d01f01ec40a0a8647598067935a3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.842949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb9d01f01ec40a0a8647598067935a3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.851990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb9d01f01ec40a0a8647598067935a3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.860979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99ebfde4-422f-4016-b87e-5acda931d899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb9d01f01ec40a0a8647598067935a3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:16.867771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1134/2287] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:16 2022] DELETE /identity/v3/users/5fb9d01f01ec40a0a8647598067935a3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:17.205290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.206885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:17.220683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0976d-795b-4d90-b8a9-f95ef4b6db55 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.302011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.302923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.303234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.303503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] PATH_INFO: `/v3/projects/8089874e6d3240cd8ebaec39308a139b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.304930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8089874e6d3240cd8ebaec39308a139b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.306773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.357486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8089874e6d3240cd8ebaec39308a139b', 'request_id': 'req-091a7e1f-1c45-490a-b2e7-161aebc298c2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:17.366883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8089874e6d3240cd8ebaec39308a139b', 'request_id': 'req-091a7e1f-1c45-490a-b2e7-161aebc298c2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:17.372599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8089874e6d3240cd8ebaec39308a139b', 'request_id': 'req-091a7e1f-1c45-490a-b2e7-161aebc298c2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:17.384797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] The token cache is being invalidate because project 8089874e6d3240cd8ebaec39308a139b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:17.385231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:17.385880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-091a7e1f-1c45-490a-b2e7-161aebc298c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:17.387414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1154/2288] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:17 2022] DELETE /identity/v3/projects/8089874e6d3240cd8ebaec39308a139b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:17.392375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7326c8-dea3-450b-9ee2-425c516718bc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.392677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7326c8-dea3-450b-9ee2-425c516718bc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.393204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7326c8-dea3-450b-9ee2-425c516718bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.413664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0e7326c8-dea3-450b-9ee2-425c516718bc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:17.414869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e7326c8-dea3-450b-9ee2-425c516718bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:17.486894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1135/2289] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:17.495438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702ed5-1e49-4d02-be7e-dfb7874e6b31 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.495730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702ed5-1e49-4d02-be7e-dfb7874e6b31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.496040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702ed5-1e49-4d02-be7e-dfb7874e6b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.515337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9e702ed5-1e49-4d02-be7e-dfb7874e6b31 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:17.516654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e702ed5-1e49-4d02-be7e-dfb7874e6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:17.526109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1155/2290] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:17.530543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7326c8-dea3-450b-9ee2-425c516718bc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.541344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7326c8-dea3-450b-9ee2-425c516718bc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.549757 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.550578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.550840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.551738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.552484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:17.552879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.554741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.581215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1136/2291] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:20:17.585313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702ed5-1e49-4d02-be7e-dfb7874e6b31 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.595332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702ed5-1e49-4d02-be7e-dfb7874e6b31 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.600240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.601036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.601403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.601752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.602651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.604742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.640388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1156/2292] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:17 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:17.645533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.664170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bde18-35cd-4f40-a57f-3e6127a7249e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.695011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:17.777847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.778860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.779243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.779691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.780859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.782619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.812203 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1137/2293] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:17 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:17.813324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.820351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:17.827350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05756-7e22-46b2-bc0c-b8d6e2780fa3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.833514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.834217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.834485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.834775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.835518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.837170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.850332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1157/2294] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:17.854437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.865035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd6c26-2c87-4b1a-a1ea-aa443b660a9a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.870034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b00486-8e0b-4f7c-84aa-0aaf05b58b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.870700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00486-8e0b-4f7c-84aa-0aaf05b58b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.870988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00486-8e0b-4f7c-84aa-0aaf05b58b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.871441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00486-8e0b-4f7c-84aa-0aaf05b58b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.872361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b00486-8e0b-4f7c-84aa-0aaf05b58b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.874007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b00486-8e0b-4f7c-84aa-0aaf05b58b72 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.888471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1138/2295] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:17.889770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.900883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349a552-2a17-4a24-a9ac-5dfcdb593649 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.906420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.907251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.907534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.907809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] PATH_INFO: `/v3/projects/ec3d122e353346e287f9668290787702/users/82ff5a76a137428fa0b4087e38cb7ebf/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.925196 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3d122e353346e287f9668290787702, user_id=82ff5a76a137428fa0b4087e38cb7ebf, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.927983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.942980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1158/2296] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:17 2022] PUT /identity/v3/projects/ec3d122e353346e287f9668290787702/users/82ff5a76a137428fa0b4087e38cb7ebf/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:17.954325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.954615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.955261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.990477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] MFA Rules not processed for user `82ff5a76a137428fa0b4087e38cb7ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:17.991620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:18.094376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1139/2297] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:18.100928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.114780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.117032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:18.188678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f8318-f58b-4496-b3db-6952b79d9d10 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.195839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.196492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.196859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.197152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.199205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:18.210337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d9967-e703-4dcd-81d7-d8cd6b349684 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.215182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.215851 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.216140 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.216422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.217150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.219072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.250373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1159/2298] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:18 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:18.255036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.256064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:18.278622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.280112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.290548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1140/2299] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:20:18.322789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86e21c-f423-424e-b129-cc820085a922 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.327584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.328267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.328556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.328862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.329698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.331709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.369647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1160/2300] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:18 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:18.374039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.386179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec461-f580-409c-b7df-5e5f477d693a service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.391115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.391794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.392079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.392365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.393283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.394892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.409020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1141/2301] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:18.410169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.420395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0e77c-fe28-40b3-9706-e3c422e708b6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.425956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.427027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.427326 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.427693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] PATH_INFO: `/v3/projects/463d72c45d8a4184911a87a53f19e9dd/users/94661b10474e4e7ba39620c50e3f60b8/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.445576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=463d72c45d8a4184911a87a53f19e9dd, user_id=94661b10474e4e7ba39620c50e3f60b8, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.448327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.463025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1161/2302] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:18 2022] PUT /identity/v3/projects/463d72c45d8a4184911a87a53f19e9dd/users/94661b10474e4e7ba39620c50e3f60b8/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:18.467224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.478294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b24014-82b7-4b42-94e2-bfa971fe2436 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.544964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6760a99-d056-487d-9b49-a2a7c3e46bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.545659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760a99-d056-487d-9b49-a2a7c3e46bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.545976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760a99-d056-487d-9b49-a2a7c3e46bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.546257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760a99-d056-487d-9b49-a2a7c3e46bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.546991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6760a99-d056-487d-9b49-a2a7c3e46bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.548714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6760a99-d056-487d-9b49-a2a7c3e46bd6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.558764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1142/2303] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:18.563055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.574029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2990e-d318-49ca-a159-41a01f50ac4c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.584141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.588956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.588956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.588956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] PATH_INFO: `/v3/projects/463d72c45d8a4184911a87a53f19e9dd/users/94661b10474e4e7ba39620c50e3f60b8/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.590788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463d72c45d8a4184911a87a53f19e9dd, user_id=94661b10474e4e7ba39620c50e3f60b8, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.593567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.607143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1162/2304] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:18 2022] PUT /identity/v3/projects/463d72c45d8a4184911a87a53f19e9dd/users/94661b10474e4e7ba39620c50e3f60b8/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:18.617620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aeba4-ccee-45ec-8a80-1dfa3f012c12 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.617989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aeba4-ccee-45ec-8a80-1dfa3f012c12 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.618339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aeba4-ccee-45ec-8a80-1dfa3f012c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.650892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d52aeba4-ccee-45ec-8a80-1dfa3f012c12 None None] MFA Rules not processed for user `94661b10474e4e7ba39620c50e3f60b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:18.652223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d52aeba4-ccee-45ec-8a80-1dfa3f012c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:18.747076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1143/2305] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:18.794416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.798203 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:18.809689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:18.890802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a9edd-cf68-4b72-9ee7-3ece7fed5cb1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.898701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be49f8-1372-4f34-bf0e-f1e60f0359b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.899364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be49f8-1372-4f34-bf0e-f1e60f0359b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.899780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be49f8-1372-4f34-bf0e-f1e60f0359b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.900199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be49f8-1372-4f34-bf0e-f1e60f0359b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.911552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be49f8-1372-4f34-bf0e-f1e60f0359b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.913041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be49f8-1372-4f34-bf0e-f1e60f0359b2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.925695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1163/2306] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:19.461761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aeba4-ccee-45ec-8a80-1dfa3f012c12 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:19.520107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:19.538632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aeba4-ccee-45ec-8a80-1dfa3f012c12 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:19.544912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:19.545903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:19.546356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:19.546729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] PATH_INFO: `/v3/users/82ff5a76a137428fa0b4087e38cb7ebf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:19.548121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ff5a76a137428fa0b4087e38cb7ebf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:19.550904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:19.600853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ff5a76a137428fa0b4087e38cb7ebf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:19.617179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ff5a76a137428fa0b4087e38cb7ebf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:19.617939 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ff5a76a137428fa0b4087e38cb7ebf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:19.627243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ff5a76a137428fa0b4087e38cb7ebf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:19.634770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ff5a76a137428fa0b4087e38cb7ebf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:19.641814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1144/2307] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:19 2022] DELETE /identity/v3/users/82ff5a76a137428fa0b4087e38cb7ebf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:19.647286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:19.647792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:19.647885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:19.666091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:19.667400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:19.730047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1164/2308] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:19.739942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:19.741714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:19.816517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce4fc8-b804-467c-93eb-b2f4df477a57 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:19.820478 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:19.821290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:19.821578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:19.821850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:19.834763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:19.836219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:19.852655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1145/2309] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:20.147173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:20.148737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:20.169060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5f3ad-97d6-4f5d-ac14-2b6b0b7e5206 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:20.175032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:20.175894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.176185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.176704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] PATH_INFO: `/v3/projects/ec3d122e353346e287f9668290787702` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:20.177834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3d122e353346e287f9668290787702)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:20.180037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:20.241816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3d122e353346e287f9668290787702', 'request_id': 'req-03e9e353-aa29-4025-99fe-4c2c07a28f76'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.252328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3d122e353346e287f9668290787702', 'request_id': 'req-03e9e353-aa29-4025-99fe-4c2c07a28f76'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.259148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3d122e353346e287f9668290787702', 'request_id': 'req-03e9e353-aa29-4025-99fe-4c2c07a28f76'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.281627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] The token cache is being invalidate because project ec3d122e353346e287f9668290787702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:20.281627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.282291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.284581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1165/2310] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:20 2022] DELETE /identity/v3/projects/ec3d122e353346e287f9668290787702 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:20.288506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:20.304133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4dbe-c97c-4070-9190-5fd9d855f56e service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:20.400305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:20.401999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.402519 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.402876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] PATH_INFO: `/v3/users/94661b10474e4e7ba39620c50e3f60b8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:20.404287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94661b10474e4e7ba39620c50e3f60b8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:20.406440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:20.427033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:20.502434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94661b10474e4e7ba39620c50e3f60b8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.531511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94661b10474e4e7ba39620c50e3f60b8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.533522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94661b10474e4e7ba39620c50e3f60b8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.545766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94661b10474e4e7ba39620c50e3f60b8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.555927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9d9c2204-f5c5-406d-bf9d-b248aa630192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94661b10474e4e7ba39620c50e3f60b8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.564973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1146/2311] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:20 2022] DELETE /identity/v3/users/94661b10474e4e7ba39620c50e3f60b8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:20.947623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:20.949975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:20.971260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e353-aa29-4025-99fe-4c2c07a28f76 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.016388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:21.073734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.074692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.075045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.075487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] PATH_INFO: `/v3/projects/463d72c45d8a4184911a87a53f19e9dd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.077641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] RBAC: Authorizing `identity:delete_project(project_id=463d72c45d8a4184911a87a53f19e9dd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.080583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.144479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463d72c45d8a4184911a87a53f19e9dd', 'request_id': 'req-53209e1a-c61f-4946-8843-ac95d705606c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:21.155854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463d72c45d8a4184911a87a53f19e9dd', 'request_id': 'req-53209e1a-c61f-4946-8843-ac95d705606c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:21.163993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463d72c45d8a4184911a87a53f19e9dd', 'request_id': 'req-53209e1a-c61f-4946-8843-ac95d705606c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:21.180045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] The token cache is being invalidate because project 463d72c45d8a4184911a87a53f19e9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:21.180990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:21.181108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-53209e1a-c61f-4946-8843-ac95d705606c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:21.183021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1166/2312] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:20 2022] DELETE /identity/v3/projects/463d72c45d8a4184911a87a53f19e9dd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:21.187780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593e5e5-fda7-491e-8730-8d8545ae60e0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.188307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593e5e5-fda7-491e-8730-8d8545ae60e0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.188717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593e5e5-fda7-491e-8730-8d8545ae60e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.230185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2593e5e5-fda7-491e-8730-8d8545ae60e0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:21.231704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2593e5e5-fda7-491e-8730-8d8545ae60e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:21.323224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1147/2313] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:21.332607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b4c19-bfaf-4ad1-9951-fc78946c75c5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.332927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b4c19-bfaf-4ad1-9951-fc78946c75c5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.333812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b4c19-bfaf-4ad1-9951-fc78946c75c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.358669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8b5b4c19-bfaf-4ad1-9951-fc78946c75c5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:21.359542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8b5b4c19-bfaf-4ad1-9951-fc78946c75c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:21.371655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1167/2314] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:21.375877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593e5e5-fda7-491e-8730-8d8545ae60e0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.388930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593e5e5-fda7-491e-8730-8d8545ae60e0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.395509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.396124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.396412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.396689 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.397684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:21.398181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.399973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.414969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1148/2315] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:20:21.419676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b4c19-bfaf-4ad1-9951-fc78946c75c5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.431879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b4c19-bfaf-4ad1-9951-fc78946c75c5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.439781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.440883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.441461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.441907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.442782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.445979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.491119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1168/2316] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:21.495556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.521917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d884-642a-44fc-af36-272d7a4857a6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.610482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.610852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.611726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.612483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.613751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.617305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.671187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1149/2317] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:21.671933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.701179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28197f8-cf69-46d8-b0d3-ba6f747637bb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.708374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.709422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.710267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.710777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.711603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.713390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.738548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.739499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1169/2318] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:21.749493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf559-03cf-409f-8ea8-e929583db2f9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.755577 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59671bc8-5203-4001-b27e-f5a641859cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.756219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671bc8-5203-4001-b27e-f5a641859cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.756529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671bc8-5203-4001-b27e-f5a641859cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.756864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671bc8-5203-4001-b27e-f5a641859cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.757858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59671bc8-5203-4001-b27e-f5a641859cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.759575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59671bc8-5203-4001-b27e-f5a641859cdc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.763240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:21.776736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1150/2319] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:21.779865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.791453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4e4f9-2893-4079-98c4-f958b8354535 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.803383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.804389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.804742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.805214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] PATH_INFO: `/v3/projects/4c97808ff27c4b44a5fd7a799f897620/users/f151ed2cbddf4e64858f9ae7c39aac03/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.857832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c97808ff27c4b44a5fd7a799f897620, user_id=f151ed2cbddf4e64858f9ae7c39aac03, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.861135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.892187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1170/2320] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:21 2022] PUT /identity/v3/projects/4c97808ff27c4b44a5fd7a799f897620/users/f151ed2cbddf4e64858f9ae7c39aac03/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:21.894771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9759-2865-4b57-99b7-242d5fd59022 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.895057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9759-2865-4b57-99b7-242d5fd59022 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.895438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c9759-2865-4b57-99b7-242d5fd59022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.926458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d03c9759-2865-4b57-99b7-242d5fd59022 None None] MFA Rules not processed for user `f151ed2cbddf4e64858f9ae7c39aac03`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:21.927793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d03c9759-2865-4b57-99b7-242d5fd59022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:22.062103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1151/2321] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:22.074778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:22.076604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:22.171350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9635938-2b2a-44fd-b7ad-7596c3d9b791 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:22.176110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d70f4-9225-4c65-a480-55b0b579ec12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:22.176838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d70f4-9225-4c65-a480-55b0b579ec12 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:22.177143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d70f4-9225-4c65-a480-55b0b579ec12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:22.177427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d70f4-9225-4c65-a480-55b0b579ec12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:22.196521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d70f4-9225-4c65-a480-55b0b579ec12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:22.201960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d70f4-9225-4c65-a480-55b0b579ec12 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:22.207632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:22.220123 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1171/2322] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:22.245139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c9759-2865-4b57-99b7-242d5fd59022 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:22.323211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c9759-2865-4b57-99b7-242d5fd59022 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:22.328223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:22.329191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:22.329480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:22.330343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] PATH_INFO: `/v3/users/f151ed2cbddf4e64858f9ae7c39aac03` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:22.331656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f151ed2cbddf4e64858f9ae7c39aac03)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:22.333650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:22.394556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f151ed2cbddf4e64858f9ae7c39aac03'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:22.407082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f151ed2cbddf4e64858f9ae7c39aac03'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:22.408528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f151ed2cbddf4e64858f9ae7c39aac03'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:22.418182 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f151ed2cbddf4e64858f9ae7c39aac03'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:22.425853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f151ed2cbddf4e64858f9ae7c39aac03'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:22.432252 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1152/2323] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:22 2022] DELETE /identity/v3/users/f151ed2cbddf4e64858f9ae7c39aac03 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:22.437240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:22.437704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:22.438232 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:22.459957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:22.462153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:22.529356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1172/2324] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:22.539999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:22.541512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:22.551390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:22.605195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e6e7e-e08d-4788-9d41-62eee0a4a896 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:22.609170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b665ab-7fe5-4d8d-b0d3-48d15d1b9cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:22.609870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b665ab-7fe5-4d8d-b0d3-48d15d1b9cff service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:22.610122 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b665ab-7fe5-4d8d-b0d3-48d15d1b9cff service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:22.610536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b665ab-7fe5-4d8d-b0d3-48d15d1b9cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:22.623081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b665ab-7fe5-4d8d-b0d3-48d15d1b9cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:22.623391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b665ab-7fe5-4d8d-b0d3-48d15d1b9cff service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:22.647599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1153/2325] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:20:23.154879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.156939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:23.170769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1370-6d58-4b08-acee-469ae586dcb5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.176598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.177695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.177987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.178530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] PATH_INFO: `/v3/projects/4c97808ff27c4b44a5fd7a799f897620` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.179852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c97808ff27c4b44a5fd7a799f897620)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.181990 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.235474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c97808ff27c4b44a5fd7a799f897620', 'request_id': 'req-0575e63d-fbb6-4842-ae6b-852b01ed86a8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:23.244394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c97808ff27c4b44a5fd7a799f897620', 'request_id': 'req-0575e63d-fbb6-4842-ae6b-852b01ed86a8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:23.253011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c97808ff27c4b44a5fd7a799f897620', 'request_id': 'req-0575e63d-fbb6-4842-ae6b-852b01ed86a8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:23.264579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] The token cache is being invalidate because project 4c97808ff27c4b44a5fd7a799f897620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:23.264896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:23.265549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0575e63d-fbb6-4842-ae6b-852b01ed86a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:23.267102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1173/2326] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:23 2022] DELETE /identity/v3/projects/4c97808ff27c4b44a5fd7a799f897620 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:23.272378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb9d7-b087-4604-8209-93389c10cb05 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.272925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb9d7-b087-4604-8209-93389c10cb05 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.273218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb9d7-b087-4604-8209-93389c10cb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.293512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e25bb9d7-b087-4604-8209-93389c10cb05 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:23.295006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e25bb9d7-b087-4604-8209-93389c10cb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:23.358111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1154/2327] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:23.366708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111479e-0b92-4c14-a5ba-008fcf8534af None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.367007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111479e-0b92-4c14-a5ba-008fcf8534af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.367290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111479e-0b92-4c14-a5ba-008fcf8534af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.386158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8111479e-0b92-4c14-a5ba-008fcf8534af None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:23.387414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8111479e-0b92-4c14-a5ba-008fcf8534af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:23.395627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1174/2328] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:23.400024 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb9d7-b087-4604-8209-93389c10cb05 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.410419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb9d7-b087-4604-8209-93389c10cb05 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.415083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.415745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.416029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.416428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.417196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:23.417505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.419112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.433318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1155/2329] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:20:23.439526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111479e-0b92-4c14-a5ba-008fcf8534af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.450767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111479e-0b92-4c14-a5ba-008fcf8534af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.455459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.456114 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.456397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.456682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.457417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.459330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.489556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1175/2330] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:23 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:23.491176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.501918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb03a1-1be2-4e91-a603-fffcce31950a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.594148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.594873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.595104 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.595932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.596623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.598633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.622597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1156/2331] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:23 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:23.623791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.634397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0f50-e285-4cd6-8fe3-63f25b8d32ab admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.639799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.640579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.640883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.641189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.641917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.643585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.656693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1176/2332] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:23.661482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.671909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0fe8c-0732-4d72-a584-33220ec3e152 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.677458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a3c65-6f20-42f7-b51c-46c9f1da170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.678131 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3c65-6f20-42f7-b51c-46c9f1da170f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.678422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3c65-6f20-42f7-b51c-46c9f1da170f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.678708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3c65-6f20-42f7-b51c-46c9f1da170f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.679441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a3c65-6f20-42f7-b51c-46c9f1da170f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.681090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a3c65-6f20-42f7-b51c-46c9f1da170f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.695105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1157/2333] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:23.696392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.707268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fbc71-2a4a-42cd-9ff4-db9005dedb06 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.712101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.713022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.713309 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.713591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] PATH_INFO: `/v3/projects/704069d3a04b445a949da1fa044bec01/users/a6f679b3183d43c6abf6d246e3ca4ada/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.728941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=704069d3a04b445a949da1fa044bec01, user_id=a6f679b3183d43c6abf6d246e3ca4ada, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.731587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.746888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1177/2334] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:23 2022] PUT /identity/v3/projects/704069d3a04b445a949da1fa044bec01/users/a6f679b3183d43c6abf6d246e3ca4ada/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:23.757116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f2fd-df39-4fe6-8ee7-3b326fd99c9b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.757512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f2fd-df39-4fe6-8ee7-3b326fd99c9b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.757901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f2fd-df39-4fe6-8ee7-3b326fd99c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.786219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ec19f2fd-df39-4fe6-8ee7-3b326fd99c9b None None] MFA Rules not processed for user `a6f679b3183d43c6abf6d246e3ca4ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:23.787444 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ec19f2fd-df39-4fe6-8ee7-3b326fd99c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:23.791540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:23.853676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1158/2335] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:23.864479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:23.866457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:23.888942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:23.931726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de793-8f33-40ce-b890-f5cad3edc87f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:23.935642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44eba-662d-4c6e-afeb-3af6b773a8bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:23.936962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44eba-662d-4c6e-afeb-3af6b773a8bc service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:23.937254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44eba-662d-4c6e-afeb-3af6b773a8bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:23.937540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44eba-662d-4c6e-afeb-3af6b773a8bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:23.947446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44eba-662d-4c6e-afeb-3af6b773a8bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:23.948853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44eba-662d-4c6e-afeb-3af6b773a8bc service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:23.960204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1178/2336] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:33.510039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f2fd-df39-4fe6-8ee7-3b326fd99c9b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:33.584099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f2fd-df39-4fe6-8ee7-3b326fd99c9b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:33.589470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:33.591804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:33.591804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:33.591804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] PATH_INFO: `/v3/users/a6f679b3183d43c6abf6d246e3ca4ada` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:33.593696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f679b3183d43c6abf6d246e3ca4ada)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:33.598078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:33.672502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f679b3183d43c6abf6d246e3ca4ada'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:33.689556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f679b3183d43c6abf6d246e3ca4ada'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:33.690976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f679b3183d43c6abf6d246e3ca4ada'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:33.702427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f679b3183d43c6abf6d246e3ca4ada'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:33.712485 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f679b3183d43c6abf6d246e3ca4ada'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:33.719546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1159/2337] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:33 2022] DELETE /identity/v3/users/a6f679b3183d43c6abf6d246e3ca4ada => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:33.725223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:33.725703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:33.725801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:33.746689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:33.748312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:33.827789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1179/2338] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:33.838161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:33.840229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:33.890215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:33.891086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:33.893594 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:33.909038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f38b5-689f-48fd-8e0b-882716a8f442 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:33.913808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:33.915010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:33.915413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:33.915696 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] PATH_INFO: `/v3/users/95ea05beeec34d138cf33fc907420c65` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:33.916972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ea05beeec34d138cf33fc907420c65)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:33.919153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:33.931370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091cc5-9a92-46af-89b1-8328998fc352 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:33.937056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce5b3f-5eee-4eab-8196-bd06882028d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:33.937735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce5b3f-5eee-4eab-8196-bd06882028d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:33.938020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce5b3f-5eee-4eab-8196-bd06882028d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:33.939821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce5b3f-5eee-4eab-8196-bd06882028d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:33.952238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce5b3f-5eee-4eab-8196-bd06882028d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:33.955026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce5b3f-5eee-4eab-8196-bd06882028d2 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:33.972063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1160/2339] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:33.978351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ea05beeec34d138cf33fc907420c65'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:33.995261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ea05beeec34d138cf33fc907420c65'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.005206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ea05beeec34d138cf33fc907420c65'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.017332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ea05beeec34d138cf33fc907420c65'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.018387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ea05beeec34d138cf33fc907420c65'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.026600 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1180/2340] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:33 2022] DELETE /identity/v3/users/95ea05beeec34d138cf33fc907420c65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:34.034168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.034464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.034748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.061476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:34.064897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.155282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1161/2341] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:34.165225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.166669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.220844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:34.242850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a69c8-658c-4e25-be22-61795e123f14 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:34.246669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35ce2-d5b0-490a-b78e-1cab98bb49f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:34.247322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35ce2-d5b0-490a-b78e-1cab98bb49f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.247604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35ce2-d5b0-490a-b78e-1cab98bb49f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.247885 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35ce2-d5b0-490a-b78e-1cab98bb49f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.262070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35ce2-d5b0-490a-b78e-1cab98bb49f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:34.263623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35ce2-d5b0-490a-b78e-1cab98bb49f2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:34.275076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1181/2342] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:34.447546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.449458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.464175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409de22-00e7-425c-a440-7e3c747c84ed None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:34.469506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:34.470631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.471021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.471335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] PATH_INFO: `/v3/projects/704069d3a04b445a949da1fa044bec01` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.472703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704069d3a04b445a949da1fa044bec01)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:34.474847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:34.530288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704069d3a04b445a949da1fa044bec01', 'request_id': 'req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.538351 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704069d3a04b445a949da1fa044bec01', 'request_id': 'req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.547824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704069d3a04b445a949da1fa044bec01', 'request_id': 'req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.560919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] The token cache is being invalidate because project 704069d3a04b445a949da1fa044bec01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:34.561217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.561952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.564327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1162/2343] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:34 2022] DELETE /identity/v3/projects/704069d3a04b445a949da1fa044bec01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:34.569442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d058d-ed1d-4cc0-a38b-a990d98cdb10 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.569754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d058d-ed1d-4cc0-a38b-a990d98cdb10 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.570065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d058d-ed1d-4cc0-a38b-a990d98cdb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.588426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-033d058d-ed1d-4cc0-a38b-a990d98cdb10 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:34.589652 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-033d058d-ed1d-4cc0-a38b-a990d98cdb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.637560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.639135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.673543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1182/2344] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:34.683284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6964a-6cd0-457b-81f5-052065794bb0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.683670 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6964a-6cd0-457b-81f5-052065794bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.684101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6964a-6cd0-457b-81f5-052065794bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.703425 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92f6964a-6cd0-457b-81f5-052065794bb0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:34.705400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92f6964a-6cd0-457b-81f5-052065794bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.716973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1183/2345] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:34.718670 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6964a-6cd0-457b-81f5-052065794bb0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.721399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:34.728768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6964a-6cd0-457b-81f5-052065794bb0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:34.734524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:34.735453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.735735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.736178 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.736852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fa28-b523-4db9-8a45-e21d0633e7e3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:34.736962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:34.737255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:34.738935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:34.741877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:34.742744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.743028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.743313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] PATH_INFO: `/v3/projects/53251dddae4747a1aaea632a36cd8dd7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.744502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53251dddae4747a1aaea632a36cd8dd7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:34.746461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:34.752864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1184/2346] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:20:34.756593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.767732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39add92f-daab-44b5-b106-1bfe0eec474a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:34.772387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:34.773059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.773347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.773629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.774305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:34.776890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:34.796683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53251dddae4747a1aaea632a36cd8dd7', 'request_id': 'req-379cc326-dc43-41f5-93a0-1d9d6c54be5e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.802962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53251dddae4747a1aaea632a36cd8dd7', 'request_id': 'req-379cc326-dc43-41f5-93a0-1d9d6c54be5e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.812786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53251dddae4747a1aaea632a36cd8dd7', 'request_id': 'req-379cc326-dc43-41f5-93a0-1d9d6c54be5e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.820678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1185/2347] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:34 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:34.821993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.827591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] The token cache is being invalidate because project 53251dddae4747a1aaea632a36cd8dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:34.827882 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.828556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-379cc326-dc43-41f5-93a0-1d9d6c54be5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:34.830980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1163/2348] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:34 2022] DELETE /identity/v3/projects/53251dddae4747a1aaea632a36cd8dd7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:34.836633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649a1d1-0941-4776-84c5-bc5c6821277a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.837214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649a1d1-0941-4776-84c5-bc5c6821277a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.837214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649a1d1-0941-4776-84c5-bc5c6821277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.855636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3649a1d1-0941-4776-84c5-bc5c6821277a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:34.856875 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3649a1d1-0941-4776-84c5-bc5c6821277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.888940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c6f68-6065-463e-8bea-1dbe1c2bbb50 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:34.894936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:34.895716 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.896014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.897065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.897982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:34.900147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:34.930592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1186/2349] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:34 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:34.934656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.942588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.953201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1164/2350] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:34.957831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf527-df2d-4d6b-94fb-348c16f3752f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:34.960963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365d13f-f355-4dc6-bc88-3be5dd18d83e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.961308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365d13f-f355-4dc6-bc88-3be5dd18d83e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.961591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365d13f-f355-4dc6-bc88-3be5dd18d83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.964920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:34.965697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:34.966086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:34.966468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:34.967303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:34.969042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:34.980651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7365d13f-f355-4dc6-bc88-3be5dd18d83e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:34.980900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1187/2351] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:34.981745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7365d13f-f355-4dc6-bc88-3be5dd18d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:34.985083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:34.999373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7e86f-980a-4e19-a26d-2fa96556c50b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.003056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1165/2352] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:35.003609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365d13f-f355-4dc6-bc88-3be5dd18d83e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.006893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.007236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.007617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.008011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.009044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.011406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.014018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365d13f-f355-4dc6-bc88-3be5dd18d83e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.020177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.021071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.021430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.021853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.022779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:35.024117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.025549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1188/2353] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:35.025990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.029939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.036701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:35.040665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24977-6b91-40ad-ad80-884cd67fb6bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.046845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675ff55-425d-41f9-ab32-07f8075d881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.048934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ff55-425d-41f9-ab32-07f8075d881d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.049336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ff55-425d-41f9-ab32-07f8075d881d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.049709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ff55-425d-41f9-ab32-07f8075d881d admin admin] PATH_INFO: `/v3/projects/88096d45ff8747c7ae1cb75c4423b8cf/users/53a2b93781bd4138882daacf9a3b64d3/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.057204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1166/2354] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:20:35.062229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.073962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84765f29-795e-4ee1-aa62-0608a8d563fe admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.076573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675ff55-425d-41f9-ab32-07f8075d881d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88096d45ff8747c7ae1cb75c4423b8cf, user_id=53a2b93781bd4138882daacf9a3b64d3, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.079543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.079740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675ff55-425d-41f9-ab32-07f8075d881d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.080569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.080954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.081684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.082053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.084021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.098061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1189/2355] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:35 2022] PUT /identity/v3/projects/88096d45ff8747c7ae1cb75c4423b8cf/users/53a2b93781bd4138882daacf9a3b64d3/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:35.115531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.116854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.116854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.130505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1167/2356] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:35 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:35.136167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.180251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] MFA Rules not processed for user `53a2b93781bd4138882daacf9a3b64d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:35.181662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:35.202885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:35.245116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53ae8-4cdc-4ec0-9bb4-568c65f708af admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.251226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.251979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.252296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.252584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.253334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.255615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.291135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1168/2357] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:35 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:35.294804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.299800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1190/2358] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:35.309176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.311780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:35.311913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604a3b8-bf92-462b-b079-c51b88bc0332 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.318938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.319807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.320093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.320434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.321613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.324423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.339781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1169/2359] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:35.341020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.352611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72370c-3b3a-4471-b442-86b945dde985 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.360922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.360922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.360922 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.362072 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.362941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.366174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.383332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1170/2360] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:35.384973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.398128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176dab2-fbcb-47bc-983f-661827144be5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.404245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.405305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.405693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.406085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] PATH_INFO: `/v3/projects/c79eef943f754f0591d46b284f3a0599/users/335abc60577541fab28671ec0127620f/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.406488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0f0b8-dbc6-4437-b728-3a49f8ad685a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.412001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e5d19-6fa9-4def-84b8-0e643f677654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.413069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e5d19-6fa9-4def-84b8-0e643f677654 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.413997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e5d19-6fa9-4def-84b8-0e643f677654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.413997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e5d19-6fa9-4def-84b8-0e643f677654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.425543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79eef943f754f0591d46b284f3a0599, user_id=335abc60577541fab28671ec0127620f, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.426980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e5d19-6fa9-4def-84b8-0e643f677654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.428564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e5d19-6fa9-4def-84b8-0e643f677654 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.429515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.443772 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1191/2361] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:20:35.458886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1171/2362] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:35 2022] PUT /identity/v3/projects/c79eef943f754f0591d46b284f3a0599/users/335abc60577541fab28671ec0127620f/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:35.470620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff099-b0e8-43c1-a4c1-146928cacad9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.471559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff099-b0e8-43c1-a4c1-146928cacad9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.472544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff099-b0e8-43c1-a4c1-146928cacad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.512724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6d5ff099-b0e8-43c1-a4c1-146928cacad9 None None] MFA Rules not processed for user `335abc60577541fab28671ec0127620f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:35.514802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6d5ff099-b0e8-43c1-a4c1-146928cacad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:35.616881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1192/2363] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:35.629859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.631373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:35.710275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b0c2-9c97-432b-9c51-d08445a91964 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.715375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255682d-6668-42ea-9e39-b7212ce58e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.716126 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255682d-6668-42ea-9e39-b7212ce58e33 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.716612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255682d-6668-42ea-9e39-b7212ce58e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.717359 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255682d-6668-42ea-9e39-b7212ce58e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.729247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255682d-6668-42ea-9e39-b7212ce58e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.730743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255682d-6668-42ea-9e39-b7212ce58e33 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.741132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1172/2364] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:35.770588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff099-b0e8-43c1-a4c1-146928cacad9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:35.775259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:35.844375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff099-b0e8-43c1-a4c1-146928cacad9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:35.849495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:35.850369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.850656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.850933 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] PATH_INFO: `/v3/users/335abc60577541fab28671ec0127620f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.852138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335abc60577541fab28671ec0127620f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:35.854360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:35.902812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335abc60577541fab28671ec0127620f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:35.914663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335abc60577541fab28671ec0127620f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:35.923880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335abc60577541fab28671ec0127620f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:35.930783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335abc60577541fab28671ec0127620f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:35.931413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335abc60577541fab28671ec0127620f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:35.937548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1193/2365] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:35 2022] DELETE /identity/v3/users/335abc60577541fab28671ec0127620f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:35.942933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:35.943224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:35.943506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:35.963662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:35.964936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:36.025221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1173/2366] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:36.035734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:36.037214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:36.098368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b19128-3de4-4ea7-8586-e3a925c5fe32 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:36.102205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695249-b6ed-441e-a19c-4377ab2b34d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:36.102841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695249-b6ed-441e-a19c-4377ab2b34d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:36.103125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695249-b6ed-441e-a19c-4377ab2b34d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:36.103402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695249-b6ed-441e-a19c-4377ab2b34d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:36.113078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695249-b6ed-441e-a19c-4377ab2b34d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:36.114729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695249-b6ed-441e-a19c-4377ab2b34d4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:36.124406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1194/2367] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:36.405143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:36.406709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:36.423866 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274a82-dd0c-4fd6-bfc6-3ddd06f6e4c4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:36.428810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:36.429737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:36.430027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:36.430307 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] PATH_INFO: `/v3/projects/c79eef943f754f0591d46b284f3a0599` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:36.431533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79eef943f754f0591d46b284f3a0599)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:36.433563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:36.458088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:36.482365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79eef943f754f0591d46b284f3a0599', 'request_id': 'req-c2634280-7589-4011-b6bc-70b5ba561285'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:36.488728 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79eef943f754f0591d46b284f3a0599', 'request_id': 'req-c2634280-7589-4011-b6bc-70b5ba561285'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:36.496413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79eef943f754f0591d46b284f3a0599', 'request_id': 'req-c2634280-7589-4011-b6bc-70b5ba561285'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:36.507520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] The token cache is being invalidate because project c79eef943f754f0591d46b284f3a0599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:36.507816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:36.508496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2634280-7589-4011-b6bc-70b5ba561285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:36.510136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1174/2368] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:36 2022] DELETE /identity/v3/projects/c79eef943f754f0591d46b284f3a0599 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:38.068243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:38.068741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:38.068902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:38.095191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] MFA Rules not processed for user `a0b60457ec54498f89d72e69ad580fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:38.096503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:38.122237 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:38.161588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1195/2369] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:46.504358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:48.154519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=14 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:55.554638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:55.555170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:55.555264 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:55.574849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:55.576059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:55.635586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1175/2370] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:20:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:55.684916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:55.686406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:55.771137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412820dc-24ae-479a-abf2-81fee595d453 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:55.778137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80ba1-36e1-4a02-bcbe-40cd3a71d5a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:55.778798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80ba1-36e1-4a02-bcbe-40cd3a71d5a6 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:55.779083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80ba1-36e1-4a02-bcbe-40cd3a71d5a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:55.779361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80ba1-36e1-4a02-bcbe-40cd3a71d5a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:55.789030 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d80ba1-36e1-4a02-bcbe-40cd3a71d5a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:55.790727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d80ba1-36e1-4a02-bcbe-40cd3a71d5a6 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:55.801880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1196/2371] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:20:55.933663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:55.935536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:56.084991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a40de-b422-424c-8eef-b4b2e47cbfe3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:56.094905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:56.095794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:56.096180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:56.096462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] PATH_INFO: `/v3/users/53a2b93781bd4138882daacf9a3b64d3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:56.097806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a2b93781bd4138882daacf9a3b64d3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:56.100309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:56.172426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a2b93781bd4138882daacf9a3b64d3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:56.213575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a2b93781bd4138882daacf9a3b64d3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:56.214546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a2b93781bd4138882daacf9a3b64d3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:56.234843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a2b93781bd4138882daacf9a3b64d3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:56.246350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a2b93781bd4138882daacf9a3b64d3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:56.260108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1176/2372] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:55 2022] DELETE /identity/v3/users/53a2b93781bd4138882daacf9a3b64d3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:56.264668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:56.264989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:56.265274 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:56.288782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:56.292437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:56.367965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1197/2373] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:56.378557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:56.380079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:56.421839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:56.458844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c397205-da8c-4dbf-bc26-ff403ffeca5c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:56.463356 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd34ba9-02df-488e-9b00-38e226e76729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:56.464015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34ba9-02df-488e-9b00-38e226e76729 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:56.464300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34ba9-02df-488e-9b00-38e226e76729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:56.464580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34ba9-02df-488e-9b00-38e226e76729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:56.475781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd34ba9-02df-488e-9b00-38e226e76729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:56.477286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd34ba9-02df-488e-9b00-38e226e76729 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:56.490644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1177/2374] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:56.926453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:56.928740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:56.945601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912d760-6f06-46f3-8357-72c7b28705fc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:56.955834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:56.956747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:56.957150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:56.957327 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] PATH_INFO: `/v3/projects/88096d45ff8747c7ae1cb75c4423b8cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:56.958963 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88096d45ff8747c7ae1cb75c4423b8cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:56.962018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:57.042521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88096d45ff8747c7ae1cb75c4423b8cf', 'request_id': 'req-adb3399d-6afd-4b11-8560-8471136bab52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:57.058446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88096d45ff8747c7ae1cb75c4423b8cf', 'request_id': 'req-adb3399d-6afd-4b11-8560-8471136bab52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:57.072496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88096d45ff8747c7ae1cb75c4423b8cf', 'request_id': 'req-adb3399d-6afd-4b11-8560-8471136bab52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:57.086727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] The token cache is being invalidate because project 88096d45ff8747c7ae1cb75c4423b8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:57.087037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:57.087761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb3399d-6afd-4b11-8560-8471136bab52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:57.101223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1198/2375] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:56 2022] DELETE /identity/v3/projects/88096d45ff8747c7ae1cb75c4423b8cf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:21:06.483118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=15 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:07.082781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:16.900652 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93813282-6498-4808-bf30-891357e03bd3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:16.901250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93813282-6498-4808-bf30-891357e03bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:16.901358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93813282-6498-4808-bf30-891357e03bd3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:16.902722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1178/2376] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:21:16.910033 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527af2-d527-40d8-9a35-ffaaf19a549d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:16.910544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527af2-d527-40d8-9a35-ffaaf19a549d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:16.910793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527af2-d527-40d8-9a35-ffaaf19a549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:16.933746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-91527af2-d527-40d8-9a35-ffaaf19a549d None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:16.935104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91527af2-d527-40d8-9a35-ffaaf19a549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:17.019736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1199/2377] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:21:17.031825 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93813282-6498-4808-bf30-891357e03bd3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:17.034236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-93813282-6498-4808-bf30-891357e03bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:17.091106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93813282-6498-4808-bf30-891357e03bd3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:17.094656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e248c-3d5a-449f-b411-dfd767bd05a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:17.095306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e248c-3d5a-449f-b411-dfd767bd05a2 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:17.096280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e248c-3d5a-449f-b411-dfd767bd05a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:17.096793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e248c-3d5a-449f-b411-dfd767bd05a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:17.106817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e248c-3d5a-449f-b411-dfd767bd05a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:17.108234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e248c-3d5a-449f-b411-dfd767bd05a2 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:17.119342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1179/2378] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:21:17.186433 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5622-5795-4a07-88b6-f2b6356eb49c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:17.186658 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5622-5795-4a07-88b6-f2b6356eb49c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:17.186945 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5622-5795-4a07-88b6-f2b6356eb49c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:17.188349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1200/2379] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:21:17.193263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8843-0431-4ea3-bf8b-a2b4e2d4adb3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:17.193620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8843-0431-4ea3-bf8b-a2b4e2d4adb3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:17.193933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8843-0431-4ea3-bf8b-a2b4e2d4adb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:17.213127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e8eb8843-0431-4ea3-bf8b-a2b4e2d4adb3 None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:17.214369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e8eb8843-0431-4ea3-bf8b-a2b4e2d4adb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:17.279154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1180/2380] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:21:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:17.291739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d5622-5795-4a07-88b6-f2b6356eb49c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:17.293454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a65d5622-5795-4a07-88b6-f2b6356eb49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:17.308444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d5622-5795-4a07-88b6-f2b6356eb49c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:17.312639 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca875c-c90f-4870-8e98-a2972ccfe8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:17.313407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca875c-c90f-4870-8e98-a2972ccfe8ee service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:17.313794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca875c-c90f-4870-8e98-a2972ccfe8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:17.314673 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca875c-c90f-4870-8e98-a2972ccfe8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:17.322692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca875c-c90f-4870-8e98-a2972ccfe8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:17.324132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca875c-c90f-4870-8e98-a2972ccfe8ee service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:17.335591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1201/2381] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:17.419054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a23cc5-ee04-4047-be9d-7ef4a58b27ed None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:17.419350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a23cc5-ee04-4047-be9d-7ef4a58b27ed None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:17.419637 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a23cc5-ee04-4047-be9d-7ef4a58b27ed None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:17.421270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1181/2382] 10.222.0.45 () {54 vars in 921 bytes} [Thu Jul 21 04:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:21:17.428201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:17.428494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:17.428781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:17.447878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] MFA Rules not processed for user `31fbd8b38e80472e83ee62084cd19d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:17.449058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:17.459040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1202/2383] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 04:21:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:17.469614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a23cc5-ee04-4047-be9d-7ef4a58b27ed None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:17.480655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a23cc5-ee04-4047-be9d-7ef4a58b27ed None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:17.484301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e69577-9d9c-4e0a-b564-927ec8abd52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:17.484979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69577-9d9c-4e0a-b564-927ec8abd52f service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:17.485270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69577-9d9c-4e0a-b564-927ec8abd52f service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:17.485552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69577-9d9c-4e0a-b564-927ec8abd52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:17.496103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e69577-9d9c-4e0a-b564-927ec8abd52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:17.497588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e69577-9d9c-4e0a-b564-927ec8abd52f service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:17.508764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1182/2384] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:21.757931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:21.759571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:21.846883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfdea0-0345-4de2-94b6-aff9b1aa1b6b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:21.853240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:21.854038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:21.854324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:21.854603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:21.856429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:21.869915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:21.871665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:21.882607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1203/2385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:23.691889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e959bf-a1df-43cf-913c-4584d1d00ff7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:23.692399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e959bf-a1df-43cf-913c-4584d1d00ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:23.692399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e959bf-a1df-43cf-913c-4584d1d00ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:23.709982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d5e959bf-a1df-43cf-913c-4584d1d00ff7 None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:23.711165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d5e959bf-a1df-43cf-913c-4584d1d00ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:23.764850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1183/2386] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 04:21:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:23.776767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:23.778173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:23.842043 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:23.846681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4397-72f4-4ccd-94a4-1ee783eaf8c0 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:23.852216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802cd53-8713-44fb-b13e-9b05d4c704c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:23.852931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802cd53-8713-44fb-b13e-9b05d4c704c6 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:23.853223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802cd53-8713-44fb-b13e-9b05d4c704c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:23.853505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802cd53-8713-44fb-b13e-9b05d4c704c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:23.861676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802cd53-8713-44fb-b13e-9b05d4c704c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:23.863908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802cd53-8713-44fb-b13e-9b05d4c704c6 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:23.872154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1204/2387] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:21:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:21:33.758109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=80 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:33.868975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:34.038153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b8be-52fe-44ba-9feb-f0c6e454cb3b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:34.038441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b8be-52fe-44ba-9feb-f0c6e454cb3b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:34.038729 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b8be-52fe-44ba-9feb-f0c6e454cb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:34.058585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b232b8be-52fe-44ba-9feb-f0c6e454cb3b None None] MFA Rules not processed for user `dee73b614227486599454524a844d0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:34.059835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b232b8be-52fe-44ba-9feb-f0c6e454cb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:34.126364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1184/2388] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:44.115709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=25 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:48.727821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e0153-204f-4a9a-a627-b910ebfd5782 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:48.728333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e0153-204f-4a9a-a627-b910ebfd5782 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:48.728449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e0153-204f-4a9a-a627-b910ebfd5782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:48.746959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d43e0153-204f-4a9a-a627-b910ebfd5782 None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:48.748174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d43e0153-204f-4a9a-a627-b910ebfd5782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:48.756152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1205/2389] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jul 21 04:21:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:48.768585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232b8be-52fe-44ba-9feb-f0c6e454cb3b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:48.781052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232b8be-52fe-44ba-9feb-f0c6e454cb3b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:48.786486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:48.787125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:48.787405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:48.787681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:48.795658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:48.797281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:48.805885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1185/2390] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:21:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:21:58.741850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:58.801962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:23:09.951689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e0153-204f-4a9a-a627-b910ebfd5782 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:09.961167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e0153-204f-4a9a-a627-b910ebfd5782 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:09.965459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb7189-39a1-4d77-9d3f-0f37115caee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:09.966111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7189-39a1-4d77-9d3f-0f37115caee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:09.966405 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7189-39a1-4d77-9d3f-0f37115caee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:09.966693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7189-39a1-4d77-9d3f-0f37115caee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:09.968579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-15fb7189-39a1-4d77-9d3f-0f37115caee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:09.983384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb7189-39a1-4d77-9d3f-0f37115caee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:09.984813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb7189-39a1-4d77-9d3f-0f37115caee4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:09.996362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1206/2391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:23:11.115920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:11.125860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895c989-ec52-4180-807a-8d93a83f7a3a service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:11.129482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:11.130120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:11.130410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:11.130692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:11.132452 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:11.146365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:11.147791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:11.158840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1186/2392] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:23:13.607365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:13.607865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:13.607975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:13.625487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] MFA Rules not processed for user `a0b60457ec54498f89d72e69ad580fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:23:13.626679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:13.681675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1207/2393] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:23:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:23:17.467438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:17.469156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:17.482880 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ae50-3723-4e13-af53-016aea74021c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:17.488603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:17.489265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:17.489554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:17.489836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:17.491552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:17.501614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:17.503235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:17.512665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1187/2394] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:23:23.674582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=31 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:23:27.508011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=12 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:23:30.745824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:30.747212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:30.804988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3857e08-e663-4787-ac6f-7959dfd0a3af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:30.808585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:30.809250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:30.809538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:30.809817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:30.811573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:30.870806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:30.872241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:30.881190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1208/2395] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:23:32.398868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:32.410029 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975e23c-5005-4017-a61b-128a21289b3b service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:32.415536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:32.416169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:32.416457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:32.416736 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:32.418539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:32.478709 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:32.480331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:32.489660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1188/2396] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:23:40.877072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=48 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:23:42.485145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=28 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:00.110638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:00.120701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066438c5-1037-470b-b714-23d339e23a90 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:00.124246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:00.124908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:00.125195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:00.125471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:00.127247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:00.136500 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:00.137949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:00.145942 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1209/2397] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:10.142297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:22.087572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:22.089042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:22.104178 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5f798-4caf-4cba-847f-281afbdc529f service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:22.109687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:22.110856 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:22.111179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:22.111461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:22.113214 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:22.178015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:22.180230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:22.189364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1189/2398] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:32.185099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=28 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:59.328358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:59.329833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:59.342085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc507f3-de5c-438b-b99b-61ed65fc89c6 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:59.345685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:59.346325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:59.346615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:59.346902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:59.348636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:59.359260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:59.360982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:59.370269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1210/2399] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:25:09.365791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:21.600251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:21.663271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39260-e64d-4295-8c4b-d0fe95f5618e service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:21.668535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:21.669216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:21.669507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:21.669789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:21.679434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:21.681146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:21.691169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1190/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:31.686788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=27 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:17.372304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.431259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f858-7f1c-474b-9c0b-75d2a518e3e7 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.437139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.437790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.438084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.438372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.446975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.448706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.477764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1211/2401] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:27.475022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=31 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:31.190296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:31.202410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41296da-a048-4ea5-a1f0-bfd73076b27b service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:31.208495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:31.209183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.209461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.209742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.217675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:31.219277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:31.248006 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1191/2402] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:28:32.458782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:32.477579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96ff1-bd52-4587-a05d-f744e71412d0 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:32.481457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:32.482096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:32.482384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:32.482664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:32.491672 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:32.493133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:32.519936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1212/2403] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:38.806769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:38.816653 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305b24b-d575-40b4-ab89-b3b04411b1ba service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:38.820696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:38.821378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:38.821667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:38.821975 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:38.832457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:38.833930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:38.845507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1192/2404] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:42.517299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=17 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:48.840116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=19 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:20.326596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:20.346051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8ab7-7710-48a7-b77c-9808f32062c9 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:20.349660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:20.350295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:20.350584 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:20.350869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:20.358383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:20.359805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:20.367721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1213/2405] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:29:22.228325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:22.237829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeb827-01a8-4c97-8afb-9ddcb6adfe7a service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:22.241758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:22.242431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:22.242754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:22.243102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:22.251765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:22.253272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:22.280369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1193/2406] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:29:30.364120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:32.277731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=13 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:59.702407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:59.711683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7faf70-5e5f-4450-bea8-d3810b0e98ff service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:59.715231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:59.715865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:59.716148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:59.716427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:59.725265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:59.726677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:59.754108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1214/2407] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:30:09.751389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=13 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:27.605091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:27.606544 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:27.698328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c3117-85d6-4b11-ac0f-b1bff32f18ba service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:27.703393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:27.704032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:27.704315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:27.704593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:27.706487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:27.717570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:27.719162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:27.728755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1194/2408] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:32:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:32:37.724700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=41 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:33:18.506572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:33:18.516127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa90fe-7ce3-49c8-afce-98ae990ba00a service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:33:18.519719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:33:18.520360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:33:18.520648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:33:18.520966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:33:18.522819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:33:18.593156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:33:18.594518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:33:18.603462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1215/2409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:33:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:33:28.599222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:33:31.705651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:33:31.776284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2aa89-fdcb-4639-9c37-cb1926f8c4cb service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:33:31.784156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:33:31.784799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:33:31.785136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:33:31.785430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:33:31.787484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:33:31.857884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:33:31.860067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:33:31.869453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1195/2410] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:33:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:33:32.689278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:33:32.690834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:33:32.758909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92365485-2023-4390-8a19-2507505c0462 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:33:32.762502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:33:32.763132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:33:32.763416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:33:32.763691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:33:32.766607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:33:32.838712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:33:32.840157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:33:32.849836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1216/2411] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:33:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:33:41.865155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=61 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:33:42.846148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=58 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:34:02.010155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:34:02.011805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:34:02.081639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0327a1-91d8-46cf-8426-20a3ef05988f service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:34:02.085221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:34:02.085859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:34:02.086123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:34:02.086399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:34:02.088234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:34:02.235564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:34:02.236919 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:34:02.248054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1196/2412] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:34:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:34:12.243539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=36 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:34:21.315000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:34:21.324504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe38a52-7d26-4a8d-af04-c9712c26346e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:34:21.328446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:34:21.329134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:34:21.329424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:34:21.329707 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:34:21.339171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:34:21.340536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:34:21.350161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1217/2413] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:34:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:34:24.280045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:34:24.289612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424ec1b-52ba-41b4-bc24-df1333b83790 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:34:24.293327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:34:24.294028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:34:24.294317 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:34:24.294596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:34:24.296458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:34:24.305997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:34:24.307450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:34:24.316098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1197/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:34:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:34:31.345264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:34:34.312300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:34:59.594789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:34:59.596443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:34:59.612660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac5963-6f04-4089-94ee-5c2494ce8a04 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:34:59.623780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fbd8b38e80472e83ee62084cd19d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:34:59.624391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:34:59.624676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:34:59.624994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:34:59.626907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:34:59.700703 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:34:59.702422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:34:59.713580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1218/2415] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:34:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:35:09.708381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:37:31.674049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:37:31.675645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:37:31.717309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f114db-f717-489c-a90f-16eb96e2a37b service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:37:31.722368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:37:31.723008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:37:31.723290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:37:31.723567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:37:31.735933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:37:31.737561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:37:31.748483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1198/2416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:37:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:37:41.743435 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=17 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:38:32.117723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:38:32.119560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:38:32.141365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc275d7-b182-4123-ab8e-03fd828a7b27 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:38:32.144956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:38:32.145589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:38:32.145877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:38:32.146154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:38:32.168563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:38:32.170149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:38:32.200057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1219/2417] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:38:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:38:42.196556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=24 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:38:59.480963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:38:59.510044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e176770-0e2e-443e-a222-f1052c74929d service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:38:59.513684 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:38:59.514468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:38:59.514811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:38:59.515091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:38:59.523484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:38:59.524932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:38:59.552280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1199/2418] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:38:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:39:09.549669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=22 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:39:29.266372 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:39:29.285821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4deb3f-3075-48d3-a8c7-30e92a43e963 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:39:29.289397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:39:29.290040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:39:29.290330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:39:29.290613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:39:29.297868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:39:29.299293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:39:29.307429 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1220/2419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:39:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:39:39.303722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:42:36.590152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:42:36.591717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:42:36.680149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680457d-74a6-4fe3-b7be-8b4d0fcc89a0 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:42:36.685196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:42:36.685842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:42:36.686128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:42:36.686411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:42:36.688253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:42:36.699971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:42:36.701584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:42:36.711926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1200/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:42:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:42:46.707742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=41 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:43:00.558689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:43:00.568571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b85cb7-1229-4bda-8b59-4ca4174be796 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:43:00.572489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:43:00.573305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:43:00.573698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:43:00.574102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:43:00.576749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:43:00.662587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:43:00.664103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:43:00.684749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1221/2421] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:43:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:43:10.681527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:44:33.255262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:44:33.256893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:44:33.322614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e419-b29f-458d-9b89-5ea876e9af90 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:44:33.326363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:44:33.327012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:44:33.327300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:44:33.327578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:44:33.329459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:44:33.339489 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:44:33.340949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:44:33.349399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1201/2422] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:44:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:44:43.345747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=31 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:45:02.089563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:45:02.091138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:45:02.158771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5639a2-53b8-4f8c-a696-0d4379896145 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:45:02.162483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:45:02.163129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:45:02.163418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:45:02.163704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:45:02.165624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:45:02.233807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:45:02.235271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:45:02.244522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1222/2423] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:45:12.240142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=58 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:47:37.558494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:47:37.560081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:47:37.601007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88941876-4d4a-4c98-9a83-e04727b27baf service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:47:37.606025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:47:37.606661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:47:37.606946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:47:37.607224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:47:37.616368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:47:37.617971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:47:37.628325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1202/2424] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:47:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:47:47.623514 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=17 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:49:00.808026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:49:00.809630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:49:00.839688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590f25-abb9-4875-82dc-c70130bdf8dc service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:49:00.843304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:49:00.843941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:49:00.844731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:49:00.845040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:49:00.846903 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:49:00.940318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:49:00.941705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:49:00.959896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1223/2425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:49:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:49:01.161760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:49:01.182201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c927-9a89-4380-9afa-f5f04e18d45e service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:49:01.185930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:49:01.186569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:49:01.186852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:49:01.187234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:49:01.196079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:49:01.197583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:49:01.207967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1203/2426] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:49:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:49:10.957460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=56 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:49:11.203457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=11 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:49:36.270096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:49:36.289735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3d39-a830-4a7e-acf0-ffed262991b9 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:49:36.293293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:49:36.293925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:49:36.294211 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:49:36.294490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:49:36.302149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:49:36.303556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:49:36.311282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1224/2427] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:49:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:49:46.307863 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:51:02.425245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:51:02.438290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b328-e108-4d7b-8a6d-8e18c343f918 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:51:02.441959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:51:02.442597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:51:02.442883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:51:02.443163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:51:02.451617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:51:02.453625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:51:02.480375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1204/2428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:51:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:51:12.477727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=13 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:52:44.536375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:52:44.538026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:52:44.628087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c43be-45c5-4fd2-92eb-134fc99d88f6 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:52:44.633103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:52:44.633738 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:52:44.634024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:52:44.634302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:52:44.636146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:52:44.647569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:52:44.649172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:52:44.659775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1225/2429] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:52:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:52:54.654797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:53:02.880117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:02.888498 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670761-343e-4b62-848b-bc8eead070b1 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:02.893255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:02.893899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:02.894184 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:02.894460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:02.896344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:02.989967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:02.991440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:03.010339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1205/2430] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:53:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:53:13.007705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=41 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:53:24.415134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:24.416534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:24.428510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af674877-93ee-47e8-aa73-9e09c447965f service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:24.432044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:24.432666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:24.432985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:24.433262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:24.434935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:24.519791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:24.521258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:24.539841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1226/2431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:53:24.992217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.004111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d030d-f6e8-40bd-8483-38a35af6b630 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.009283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.009926 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.010212 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.010491 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.012302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:25.024555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.026188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.037194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1206/2432] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:53:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:53:25.045016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.047322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:25.068276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744503-1b6e-47d8-bce0-c7df45fa57ee service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.073227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.074164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.074454 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.074739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] PATH_INFO: `/v3/users/dee73b614227486599454524a844d0d9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.075957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee73b614227486599454524a844d0d9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.078003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.125252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee73b614227486599454524a844d0d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.137055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee73b614227486599454524a844d0d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.145732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee73b614227486599454524a844d0d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.152744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee73b614227486599454524a844d0d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.153411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d50faee0-021e-4401-a6be-4c705845e564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee73b614227486599454524a844d0d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.160229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1227/2433] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:53:25 2022] DELETE /identity/v3/users/dee73b614227486599454524a844d0d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:53:25.330801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.341497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e8624-f320-4972-b8e0-9d1575b3f664 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.400595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.401483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.401770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.402082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] PATH_INFO: `/v3/projects/08246ed171a04f08ade0288570ae9d5a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.403251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08246ed171a04f08ade0288570ae9d5a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.405247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.450467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08246ed171a04f08ade0288570ae9d5a', 'request_id': 'req-ccab775c-292c-4ee7-b368-265edd289da5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.457074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08246ed171a04f08ade0288570ae9d5a', 'request_id': 'req-ccab775c-292c-4ee7-b368-265edd289da5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.464550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08246ed171a04f08ade0288570ae9d5a', 'request_id': 'req-ccab775c-292c-4ee7-b368-265edd289da5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.475458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] The token cache is being invalidate because project 08246ed171a04f08ade0288570ae9d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:53:25.475744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.476381 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ccab775c-292c-4ee7-b368-265edd289da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:53:25.477894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1207/2434] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:53:25 2022] DELETE /identity/v3/projects/08246ed171a04f08ade0288570ae9d5a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:53:25.483257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3c2d3-67ec-477d-ba2e-161ce392a34b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.483773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3c2d3-67ec-477d-ba2e-161ce392a34b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.483910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3c2d3-67ec-477d-ba2e-161ce392a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.536844 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:53:25.540225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-77f3c2d3-67ec-477d-ba2e-161ce392a34b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:53:25.542296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77f3c2d3-67ec-477d-ba2e-161ce392a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:25.603787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1228/2435] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:53:25.612768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed4fe5-ac25-4f97-a69f-bb30f8c4f90d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.613094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed4fe5-ac25-4f97-a69f-bb30f8c4f90d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.613380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed4fe5-ac25-4f97-a69f-bb30f8c4f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.631740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-93ed4fe5-ac25-4f97-a69f-bb30f8c4f90d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:53:25.632986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-93ed4fe5-ac25-4f97-a69f-bb30f8c4f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:25.641630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1208/2436] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:53:25.645774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3c2d3-67ec-477d-ba2e-161ce392a34b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.655383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3c2d3-67ec-477d-ba2e-161ce392a34b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.659976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.660642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.660957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.661242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.661979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:53:25.662290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.663905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.676093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1229/2437] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 04:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:53:25.680602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed4fe5-ac25-4f97-a69f-bb30f8c4f90d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.690341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed4fe5-ac25-4f97-a69f-bb30f8c4f90d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.695019 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.695657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.695941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.696221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.696938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.698823 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.733330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1209/2438] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:53:25 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:53:25.738202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.748207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9bb23-7000-4622-922f-6c1398a8bda8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.803564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.804234 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.804522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.804805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.805535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.807459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.827170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1230/2439] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:53:25 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:53:25.832185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.842299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470545c9-8572-472f-94be-8b18d3c66764 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.846969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.847628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.847918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.848210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.848987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.850633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.861195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1210/2440] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:53:25.865221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.876303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37dd9-5e84-4a75-bc95-f7ecfcd30d36 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.880908 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce28e16-d9d7-40cf-a74b-c5561f3c04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.881560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce28e16-d9d7-40cf-a74b-c5561f3c04be admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.881845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce28e16-d9d7-40cf-a74b-c5561f3c04be admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.882122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce28e16-d9d7-40cf-a74b-c5561f3c04be admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.882837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce28e16-d9d7-40cf-a74b-c5561f3c04be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.884428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce28e16-d9d7-40cf-a74b-c5561f3c04be admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.895223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1231/2441] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:53:25.899217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:25.909739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf58a-7cdc-4a02-a3b1-9d050ccf91f1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:25.914378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:25.915247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.915536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.915821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] PATH_INFO: `/v3/projects/a8e7552fc5d44723b2facafe031266b9/users/62d25981e67d4d1b8e647d899939509e/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.930587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e7552fc5d44723b2facafe031266b9, user_id=62d25981e67d4d1b8e647d899939509e, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:25.933277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:25.946541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1211/2442] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:53:25 2022] PUT /identity/v3/projects/a8e7552fc5d44723b2facafe031266b9/users/62d25981e67d4d1b8e647d899939509e/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:53:25.951408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeb8e3-69f3-48de-bc1b-37faf9a95bcb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:25.951702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeb8e3-69f3-48de-bc1b-37faf9a95bcb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:25.951987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeb8e3-69f3-48de-bc1b-37faf9a95bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:25.970330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bfeeb8e3-69f3-48de-bc1b-37faf9a95bcb None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:53:25.971580 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfeeb8e3-69f3-48de-bc1b-37faf9a95bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:26.030099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1232/2443] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:53:26.039670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:26.041456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:26.048612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:53:26.100086 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f383ec-d4b4-4abd-99ae-8f90db98f0b8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:26.103650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:26.104285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:26.104567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:26.104865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:26.114589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:26.116008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:26.125756 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1212/2444] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:53:30.053242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b1e21-53bd-41ea-a0d0-989c735c9a69 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:30.053749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b1e21-53bd-41ea-a0d0-989c735c9a69 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:30.053749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b1e21-53bd-41ea-a0d0-989c735c9a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:30.080728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:53:30.084417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd4b1e21-53bd-41ea-a0d0-989c735c9a69 None None] MFA Rules not processed for user `62d25981e67d4d1b8e647d899939509e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:53:30.086368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd4b1e21-53bd-41ea-a0d0-989c735c9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:30.155621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1233/2445] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:53:30.160327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:30.170168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713bb78-5401-4d50-b3db-1a688e056848 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:30.174847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:30.175512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:30.175796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:30.176079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:30.176811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:30.178765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:30.208110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1213/2446] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 04:53:30 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:53:30.211991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b1e21-53bd-41ea-a0d0-989c735c9a69 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:30.223731 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b1e21-53bd-41ea-a0d0-989c735c9a69 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:30.284890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:30.285581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:30.285872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:30.286156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:30.286884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:30.288859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:30.310736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1234/2447] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 04:53:30 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:53:30.316093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:30.326909 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d0d21-c26f-427e-9b6e-c78430b10229 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:30.332427 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:30.333152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:30.333450 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:30.333737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:30.334477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:30.336099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:30.347523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1214/2448] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:53:30.351690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:30.363026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35c2a3-a9f2-4069-b67a-1bba2d626f54 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:30.367877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:30.368791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:30.369111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:30.369393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] PATH_INFO: `/v3/projects/25b611f6ded340fa8c5e8c14566b933e/users/c11dcd7d12a74a63aa0d8d1ab9c3cf56/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:30.386459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b611f6ded340fa8c5e8c14566b933e, user_id=c11dcd7d12a74a63aa0d8d1ab9c3cf56, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:30.389229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:30.404628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1235/2449] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:53:30 2022] PUT /identity/v3/projects/25b611f6ded340fa8c5e8c14566b933e/users/c11dcd7d12a74a63aa0d8d1ab9c3cf56/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:53:30.408557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:30.419390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecf754-e6d5-48f4-a94b-351b6d2a641f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:30.480108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ab3e-3395-4486-9dcf-e79129d83ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:30.480838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ab3e-3395-4486-9dcf-e79129d83ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:30.481162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ab3e-3395-4486-9dcf-e79129d83ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:30.481583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ab3e-3395-4486-9dcf-e79129d83ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:30.482330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ab3e-3395-4486-9dcf-e79129d83ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:30.484563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ab3e-3395-4486-9dcf-e79129d83ef9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:30.495475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1215/2450] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:53:30.500120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:53:30.510650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b6b9c-c623-44f8-9617-811044046399 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:53:30.515402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:53:30.516286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:30.516579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:30.516886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] PATH_INFO: `/v3/projects/25b611f6ded340fa8c5e8c14566b933e/users/c11dcd7d12a74a63aa0d8d1ab9c3cf56/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:30.518864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b611f6ded340fa8c5e8c14566b933e, user_id=c11dcd7d12a74a63aa0d8d1ab9c3cf56, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:53:30.521557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:53:30.531786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1236/2451] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 04:53:30 2022] PUT /identity/v3/projects/25b611f6ded340fa8c5e8c14566b933e/users/c11dcd7d12a74a63aa0d8d1ab9c3cf56/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:53:35.282655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c76605-8956-49f3-b5e8-670a38d89829 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:53:35.283146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c76605-8956-49f3-b5e8-670a38d89829 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:53:35.283239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c76605-8956-49f3-b5e8-670a38d89829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:53:35.315438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d3c76605-8956-49f3-b5e8-670a38d89829 None None] MFA Rules not processed for user `c11dcd7d12a74a63aa0d8d1ab9c3cf56`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:53:35.316923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d3c76605-8956-49f3-b5e8-670a38d89829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:53:35.393817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:53:35.404511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1216/2452] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:53:40.528009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=70,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:53:45.413982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:54:41.236288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:54:41.301441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb817a-8e16-4e73-a6d4-d46e64ffb26b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:54:41.305466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:54:41.306125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:54:41.306416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:54:41.306695 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:54:41.309046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:54:41.351597 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:54:41.353107 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:54:41.362755 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1237/2453] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:54:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:54:41.920694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c76605-8956-49f3-b5e8-670a38d89829 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:54:41.994903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c76605-8956-49f3-b5e8-670a38d89829 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:54:41.999693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:54:42.001876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:54:42.002166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:54:42.002447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] PATH_INFO: `/v3/users/62d25981e67d4d1b8e647d899939509e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:54:42.003942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d25981e67d4d1b8e647d899939509e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:54:42.005960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:54:42.052763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d25981e67d4d1b8e647d899939509e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.065027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d25981e67d4d1b8e647d899939509e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.065727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d25981e67d4d1b8e647d899939509e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.072931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d25981e67d4d1b8e647d899939509e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.080395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d25981e67d4d1b8e647d899939509e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.086235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1217/2454] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:54:41 2022] DELETE /identity/v3/users/62d25981e67d4d1b8e647d899939509e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:54:42.261053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:54:42.273917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbfe52-37d7-4d3d-9dfe-0e6e52cc9234 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:54:42.330414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:54:42.331430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:54:42.331778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:54:42.332064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] PATH_INFO: `/v3/projects/a8e7552fc5d44723b2facafe031266b9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:54:42.333291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e7552fc5d44723b2facafe031266b9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:54:42.335256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:54:42.382390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e7552fc5d44723b2facafe031266b9', 'request_id': 'req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.389525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e7552fc5d44723b2facafe031266b9', 'request_id': 'req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.395299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e7552fc5d44723b2facafe031266b9', 'request_id': 'req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.405956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] The token cache is being invalidate because project a8e7552fc5d44723b2facafe031266b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:54:42.406247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.406877 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.408442 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1238/2455] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:54:42 2022] DELETE /identity/v3/projects/a8e7552fc5d44723b2facafe031266b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:54:42.412344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:54:42.413784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:54:42.427284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10d79c-c359-4d08-9771-8b43658db37f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:54:42.482803 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:54:42.483581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:54:42.483864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:54:42.484142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] PATH_INFO: `/v3/users/c11dcd7d12a74a63aa0d8d1ab9c3cf56` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:54:42.486271 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11dcd7d12a74a63aa0d8d1ab9c3cf56)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:54:42.488041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:54:42.511240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:54:42.536004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11dcd7d12a74a63aa0d8d1ab9c3cf56'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.547413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11dcd7d12a74a63aa0d8d1ab9c3cf56'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.548953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11dcd7d12a74a63aa0d8d1ab9c3cf56'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.555978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11dcd7d12a74a63aa0d8d1ab9c3cf56'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.562918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11dcd7d12a74a63aa0d8d1ab9c3cf56'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.569595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1218/2456] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:54:42 2022] DELETE /identity/v3/users/c11dcd7d12a74a63aa0d8d1ab9c3cf56 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:54:42.743094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:54:42.744574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:54:42.758601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5322516-7e82-4bb4-90da-7bedfd1f8ba5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:54:42.778533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:54:42.821029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:54:42.821894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:54:42.822181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:54:42.822463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] PATH_INFO: `/v3/projects/25b611f6ded340fa8c5e8c14566b933e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:54:42.823641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b611f6ded340fa8c5e8c14566b933e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:54:42.825632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:54:42.871282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b611f6ded340fa8c5e8c14566b933e', 'request_id': 'req-0e386c42-43a1-44cc-91c1-5e6256ac9f24'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.878322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b611f6ded340fa8c5e8c14566b933e', 'request_id': 'req-0e386c42-43a1-44cc-91c1-5e6256ac9f24'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.883811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b611f6ded340fa8c5e8c14566b933e', 'request_id': 'req-0e386c42-43a1-44cc-91c1-5e6256ac9f24'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.894572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] The token cache is being invalidate because project 25b611f6ded340fa8c5e8c14566b933e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:54:42.894858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.895483 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:54:42.897066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1239/2457] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:54:42 2022] DELETE /identity/v3/projects/25b611f6ded340fa8c5e8c14566b933e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:54:52.566113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:54:52.891645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:57:47.480140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:57:47.481621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:57:47.575552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9fb4b-d17e-412b-b5df-c4bf4d312163 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:57:47.637137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:57:47.637784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:57:47.638066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:57:47.638340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:57:47.640108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:57:47.653049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:57:47.654650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:57:47.666010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1219/2458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:57:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:57:57.660375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=69 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:59:18.199508 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:18.200987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:18.269430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e386c42-43a1-44cc-91c1-5e6256ac9f24 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:18.273183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:18.273833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:18.274125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:18.274445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:18.276240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:18.352369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:18.353869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:18.363769 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1240/2459] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:59:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:59:18.629899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:18.651766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcee3d-873b-48b1-8551-056e9bdf2494 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:18.655768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b6b79-30a7-4f35-86d1-7e5c3e27c547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:18.656428 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6b79-30a7-4f35-86d1-7e5c3e27c547 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:18.656715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6b79-30a7-4f35-86d1-7e5c3e27c547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:18.657012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b6b79-30a7-4f35-86d1-7e5c3e27c547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:18.659026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-857b6b79-30a7-4f35-86d1-7e5c3e27c547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:18.742815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6b79-30a7-4f35-86d1-7e5c3e27c547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:18.744179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b6b79-30a7-4f35-86d1-7e5c3e27c547 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:18.755209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1220/2460] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:59:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:59:18.773733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:18.775186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:18.871216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63cf7-38af-48fb-8231-fcebe2a05643 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:18.875927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:18.876612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:18.876959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:18.877179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:18.879225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:18.927717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:59:19.027470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:19.029135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:19.049389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1241/2461] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:59:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:59:19.088132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e65fa-34ff-4102-b05e-25079a591155 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:19.088887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e65fa-34ff-4102-b05e-25079a591155 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:19.088887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e65fa-34ff-4102-b05e-25079a591155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:19.171877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-909e65fa-34ff-4102-b05e-25079a591155 None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:59:19.173667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-909e65fa-34ff-4102-b05e-25079a591155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:19.268036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1221/2462] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jul 21 04:59:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:59:19.328176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:19.329645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:19.450689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bc2c7-8e5d-4401-87f2-aa59f4c3e8bf service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:19.456119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:19.457227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:19.457227 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:19.457564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:19.466269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:19.467874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:19.477130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1242/2463] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 04:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:59:19.998294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e65fa-34ff-4102-b05e-25079a591155 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:20.008377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e65fa-34ff-4102-b05e-25079a591155 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:20.012345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:20.013034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:20.013324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:20.013604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:20.015458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:20.047493 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:59:20.079665 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:20.081154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:20.091321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1222/2464] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:59:22.882047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:22.883839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:22.899328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f073f-f3ba-496c-8b92-1eea374e0bae service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:22.904531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:22.905233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:22.905526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:22.905811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:22.907614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:22.920413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:22.922074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:22.932975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1243/2465] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:59:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:59:26.063092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:26.064647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:26.078437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540477-41d9-4eb0-8d97-e2a3390dcfb5 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:26.087843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:26.088616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:26.089070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:26.089234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] PATH_INFO: `/v3/users/58e194ed17344d28b925c37dfb593b88` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:26.090440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e194ed17344d28b925c37dfb593b88)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:26.092732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:26.144671 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e194ed17344d28b925c37dfb593b88'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.161855 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e194ed17344d28b925c37dfb593b88'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.162593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e194ed17344d28b925c37dfb593b88'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.171735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e194ed17344d28b925c37dfb593b88'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.178779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e194ed17344d28b925c37dfb593b88'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.185861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1223/2466] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:59:26 2022] DELETE /identity/v3/users/58e194ed17344d28b925c37dfb593b88 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:59:26.372537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:26.383462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdef1f-1ff9-447c-9236-3432592945e0 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:26.436206 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:59:26.445163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:26.446027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:26.446312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:26.446612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] PATH_INFO: `/v3/projects/7cab2bd8008a4da6a9d152f7b99b79e0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:26.447780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cab2bd8008a4da6a9d152f7b99b79e0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:26.449792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:26.495436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cab2bd8008a4da6a9d152f7b99b79e0', 'request_id': 'req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.501868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cab2bd8008a4da6a9d152f7b99b79e0', 'request_id': 'req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.507576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cab2bd8008a4da6a9d152f7b99b79e0', 'request_id': 'req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.518702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] The token cache is being invalidate because project 7cab2bd8008a4da6a9d152f7b99b79e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:59:26.518991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.519624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.521218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1244/2467] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:59:26 2022] DELETE /identity/v3/projects/7cab2bd8008a4da6a9d152f7b99b79e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:59:26.525813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:26.527313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:26.541163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3d2d1-37f2-42d8-b9d9-8110d036d466 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:26.596100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:26.597031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:26.597316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:26.597594 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] PATH_INFO: `/v3/users/e0a2f163fd194939be368d46e9bd5dd2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:26.613128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a2f163fd194939be368d46e9bd5dd2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:26.615051 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:26.646828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:59:26.664216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a2f163fd194939be368d46e9bd5dd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.679617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a2f163fd194939be368d46e9bd5dd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.680316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a2f163fd194939be368d46e9bd5dd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.687759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a2f163fd194939be368d46e9bd5dd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.694755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a2f163fd194939be368d46e9bd5dd2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:26.700586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1224/2468] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 04:59:26 2022] DELETE /identity/v3/users/e0a2f163fd194939be368d46e9bd5dd2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:59:26.876016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:26.877730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:26.894740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1e27-ac16-48ae-9ecd-7a84a73c56aa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:26.954294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:26.955157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:26.955443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:26.955726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] PATH_INFO: `/v3/projects/361394746ccd4f50acb1ef143aaae2f5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:26.966951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361394746ccd4f50acb1ef143aaae2f5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:26.968910 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:27.014056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361394746ccd4f50acb1ef143aaae2f5', 'request_id': 'req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:27.021262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361394746ccd4f50acb1ef143aaae2f5', 'request_id': 'req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:27.027144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361394746ccd4f50acb1ef143aaae2f5', 'request_id': 'req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:27.039009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] The token cache is being invalidate because project 361394746ccd4f50acb1ef143aaae2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:59:27.039294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:27.039930 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:59:27.041532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1245/2469] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 04:59:26 2022] DELETE /identity/v3/projects/361394746ccd4f50acb1ef143aaae2f5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:59:36.697130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=18,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:59:37.035285 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:59:47.204851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:59:47.206288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:47.271932 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728228-961c-47f1-929c-531c69aacb1d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:59:47.319320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:59:47.320521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:59:47.321007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:59:47.321292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:59:47.323159 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:59:47.333412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:59:47.334852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:59:47.343623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1225/2470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 04:59:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:59:57.340141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=50 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:02:00.878830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:02:00.882408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:02:00.898531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3eece-c3a2-4514-b5a9-c85e3a07ed06 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:02:00.902528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:02:00.903503 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:02:00.903794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:02:00.904077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:02:00.905898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:02:00.989490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:02:00.990848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:02:01.010099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1246/2471] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:02:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:02:11.007256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:02:55.478168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:02:55.479587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:02:55.569070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87089-444a-4448-b69b-d13b5001c0e4 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:02:55.574670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:02:55.575327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:02:55.575616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:02:55.575897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:02:55.577715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:02:55.589860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:02:55.591445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:02:55.601283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1226/2472] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:02:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:03:05.597191 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=41 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:04:52.193736 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:04:52.195253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:04:52.230482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587ae1-4723-49dd-9f0f-13a0fd0a1b6f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:04:52.234170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:04:52.234814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:04:52.235102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:04:52.235384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:04:52.243641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:04:52.245106 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:04:52.253414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1247/2473] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:04:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:05:02.249502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=15 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:07:01.192903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:07:01.194362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:07:01.275758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ba9f6-4940-482c-b1f5-3a49b9c46d3e service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:07:01.279418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e40fb2-0fee-4745-b144-c40fb8e32d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:07:01.280060 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40fb2-0fee-4745-b144-c40fb8e32d0d service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:07:01.280344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40fb2-0fee-4745-b144-c40fb8e32d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:07:01.280622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40fb2-0fee-4745-b144-c40fb8e32d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:07:01.289032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e40fb2-0fee-4745-b144-c40fb8e32d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:07:01.290507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e40fb2-0fee-4745-b144-c40fb8e32d0d service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:07:01.299335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1227/2474] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:07:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:07:11.295276 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=35 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:07:59.506451 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:07:59.507883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:07:59.550420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774ca83-1a33-43a7-ada7-5ea0ef96eae0 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:07:59.555444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:07:59.556078 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:07:59.556387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:07:59.556666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:07:59.565961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:07:59.567536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:07:59.577495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1248/2475] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:07:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:08:09.573097 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=17 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:09:58.196737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:09:58.197379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:09:58.197379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:09:58.251010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:09:58.252128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:09:58.323550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1228/2476] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Jul 21 05:09:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:09:58.329418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:09:58.348489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de494fac-4b3b-4b79-af6f-5b07bef15a48 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:09:58.352686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:09:58.353359 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:09:58.353647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:09:58.353932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:09:58.355804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:09:58.365302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:09:58.367354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:09:58.375559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1249/2477] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:09:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:10:08.321243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=46 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:10:08.371763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=11 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:13:03.480344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:13:03.481954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:13:03.576813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881daf28-2d5f-4c34-a7d3-8074c9149aeb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:13:03.582521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20ec02-4feb-4c2c-b034-b0061e2a5732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:13:03.583164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ec02-4feb-4c2c-b034-b0061e2a5732 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:13:03.583453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ec02-4feb-4c2c-b034-b0061e2a5732 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:13:03.583735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ec02-4feb-4c2c-b034-b0061e2a5732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:13:03.585638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bc20ec02-4feb-4c2c-b034-b0061e2a5732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:13:03.597820 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20ec02-4feb-4c2c-b034-b0061e2a5732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:13:03.599423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20ec02-4feb-4c2c-b034-b0061e2a5732 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:13:03.609510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1229/2478] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:13:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:13:13.605240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=43 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:14:59.195219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:14:59.203561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb483-3123-4938-becf-c422eccb801d service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:14:59.207160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:14:59.207790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:14:59.208076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:14:59.208357 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:14:59.216040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:14:59.217482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:14:59.225362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1250/2479] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:14:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:15:05.483863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241533d-412c-4eb9-9f39-290e2fcc366c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:15:05.484463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241533d-412c-4eb9-9f39-290e2fcc366c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:15:05.484463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241533d-412c-4eb9-9f39-290e2fcc366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:15:05.531142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8241533d-412c-4eb9-9f39-290e2fcc366c None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:15:05.532348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8241533d-412c-4eb9-9f39-290e2fcc366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:15:05.541474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1230/2480] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jul 21 05:15:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:15:05.555384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:15:05.567523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c9160-cb9a-4862-adc1-f7a1f0817da4 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:15:05.572597 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:15:05.573267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:15:05.573559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:15:05.573842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:15:05.582089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:15:05.583668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:15:05.593589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1251/2481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:15:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:15:15.528996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=13 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:15:15.589480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=12 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:17:02.198589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802d07d-6923-4e9a-93ff-924edb43866b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:17:02.199229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802d07d-6923-4e9a-93ff-924edb43866b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:17:02.199229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802d07d-6923-4e9a-93ff-924edb43866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:17:02.228673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5802d07d-6923-4e9a-93ff-924edb43866b None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:17:02.229916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5802d07d-6923-4e9a-93ff-924edb43866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:17:02.237165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1231/2482] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jul 21 05:17:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:17:02.249659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:17:02.258669 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681dd19-cc28-4855-a6a4-e4847e64e4e7 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:17:02.262332 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22a533-dacc-4c7c-8b3d-aed69e6f6d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:17:02.263479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22a533-dacc-4c7c-8b3d-aed69e6f6d78 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:17:02.263872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22a533-dacc-4c7c-8b3d-aed69e6f6d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:17:02.264163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22a533-dacc-4c7c-8b3d-aed69e6f6d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:17:02.271455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22a533-dacc-4c7c-8b3d-aed69e6f6d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:17:02.272929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22a533-dacc-4c7c-8b3d-aed69e6f6d78 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:17:02.281172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1252/2483] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:17:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:17:12.224143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=8 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:17:12.277212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:20:03.018092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff1d4-b272-4191-8714-66edef5bca52 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:20:03.018696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff1d4-b272-4191-8714-66edef5bca52 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:20:03.018696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ff1d4-b272-4191-8714-66edef5bca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:20:03.067579 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-206ff1d4-b272-4191-8714-66edef5bca52 None None] MFA Rules not processed for user `50d222dc33d04421a9cdb1672aaacbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:20:03.068870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-206ff1d4-b272-4191-8714-66edef5bca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:20:03.136121 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1232/2484] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:20:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:20:11.476095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0a28-ca73-417d-b1fb-ec36553f75f7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:20:11.476536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0a28-ca73-417d-b1fb-ec36553f75f7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:20:11.476661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0a28-ca73-417d-b1fb-ec36553f75f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:20:11.516229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-749a0a28-ca73-417d-b1fb-ec36553f75f7 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:20:11.517440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-749a0a28-ca73-417d-b1fb-ec36553f75f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:20:11.559260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1253/2485] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jul 21 05:20:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:20:11.565079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff1d4-b272-4191-8714-66edef5bca52 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:20:11.576608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ff1d4-b272-4191-8714-66edef5bca52 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:20:11.581542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:20:11.582174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:20:11.582457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:20:11.582735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:20:11.590962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:20:11.592532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:20:11.601970 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1233/2486] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:20:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:20:21.555275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:20:21.598008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=49 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:21:22.893315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d6cc-3abd-45b5-a668-ee0cd7e566f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:21:22.893922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d6cc-3abd-45b5-a668-ee0cd7e566f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:21:22.893922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d6cc-3abd-45b5-a668-ee0cd7e566f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:21:22.941046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed71d6cc-3abd-45b5-a668-ee0cd7e566f3 None None] MFA Rules not processed for user `a0b60457ec54498f89d72e69ad580fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:21:22.942186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed71d6cc-3abd-45b5-a668-ee0cd7e566f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:21:23.005953 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1254/2487] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:21:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:21:33.003081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:22:05.216306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:05.218016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:05.285761 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648fcd-55e3-48e9-9df2-ed3f101e22e0 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:05.289431 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98052ad-030c-41a9-b8e3-c3833d13ec06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:05.290089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98052ad-030c-41a9-b8e3-c3833d13ec06 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:05.290379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98052ad-030c-41a9-b8e3-c3833d13ec06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:05.290662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98052ad-030c-41a9-b8e3-c3833d13ec06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:05.298585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98052ad-030c-41a9-b8e3-c3833d13ec06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:05.300023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98052ad-030c-41a9-b8e3-c3833d13ec06 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:05.308316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1234/2488] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:22:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:22:15.304606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=30 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:22:22.050080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bad6b-cadd-4965-8b51-d2aa3d590ad7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:22.050630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bad6b-cadd-4965-8b51-d2aa3d590ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:22.050630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bad6b-cadd-4965-8b51-d2aa3d590ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:22.097294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-597bad6b-cadd-4965-8b51-d2aa3d590ad7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:22.098504 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-597bad6b-cadd-4965-8b51-d2aa3d590ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:22.166978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1255/2489] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:22.177535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4e51f-f46c-433d-96db-3a8aac6678d9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:22.177968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4e51f-f46c-433d-96db-3a8aac6678d9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:22.178088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4e51f-f46c-433d-96db-3a8aac6678d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:22.213655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-32c4e51f-f46c-433d-96db-3a8aac6678d9 None None] MFA Rules not processed for user `7456efd79db1474fa9f0b392d9c7e4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:22.214841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-32c4e51f-f46c-433d-96db-3a8aac6678d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:22.221811 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1235/2490] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Jul 21 05:22:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:22.227620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bad6b-cadd-4965-8b51-d2aa3d590ad7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:22.237630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bad6b-cadd-4965-8b51-d2aa3d590ad7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:22.241176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ca25a-6e49-4ced-8a4e-3e6007f94c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:22.241813 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca25a-6e49-4ced-8a4e-3e6007f94c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:22.242104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca25a-6e49-4ced-8a4e-3e6007f94c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:22.242388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca25a-6e49-4ced-8a4e-3e6007f94c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:22.251414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ca25a-6e49-4ced-8a4e-3e6007f94c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:22.252852 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ca25a-6e49-4ced-8a4e-3e6007f94c6f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:22.262192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1256/2491] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:22:25.542181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22d00-6308-4e0a-8e0a-efcbcb63ef19 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:25.542703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22d00-6308-4e0a-8e0a-efcbcb63ef19 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:25.542886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22d00-6308-4e0a-8e0a-efcbcb63ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:25.560864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-58c22d00-6308-4e0a-8e0a-efcbcb63ef19 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:25.562205 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-58c22d00-6308-4e0a-8e0a-efcbcb63ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:25.570900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1236/2492] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 05:22:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:25.597597 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325b59-2f25-4e1a-84ca-a4705b7e553a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:25.598612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325b59-2f25-4e1a-84ca-a4705b7e553a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:25.598994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325b59-2f25-4e1a-84ca-a4705b7e553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:25.624318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d583c-9ab3-4a5e-a2df-f5ede835e087 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:25.624687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d583c-9ab3-4a5e-a2df-f5ede835e087 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:25.625078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d583c-9ab3-4a5e-a2df-f5ede835e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:25.631079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ca325b59-2f25-4e1a-84ca-a4705b7e553a None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:25.633263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ca325b59-2f25-4e1a-84ca-a4705b7e553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:25.642301 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1257/2493] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Jul 21 05:22:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:25.643715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f06d583c-9ab3-4a5e-a2df-f5ede835e087 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:25.645098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f06d583c-9ab3-4a5e-a2df-f5ede835e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:25.649149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca325b59-2f25-4e1a-84ca-a4705b7e553a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:25.658085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1237/2494] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:25.659322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d583c-9ab3-4a5e-a2df-f5ede835e087 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:25.660288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca325b59-2f25-4e1a-84ca-a4705b7e553a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:25.665940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:25.666596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:25.666880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:25.667161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:25.669226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d583c-9ab3-4a5e-a2df-f5ede835e087 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:25.675015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:25.675886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:25.676177 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:25.676460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] PATH_INFO: `/v3/users/7b1d74995a6b407698b38e4b74e53556` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:25.676861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:25.678460 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:25.688414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1258/2495] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:22:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:22:25.690986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1d74995a6b407698b38e4b74e53556)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:25.693057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:25.740723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1d74995a6b407698b38e4b74e53556'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:25.752677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1d74995a6b407698b38e4b74e53556'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:25.753405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1d74995a6b407698b38e4b74e53556'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:25.760509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1d74995a6b407698b38e4b74e53556'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:25.767824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f3819502-75ef-4710-9a1d-d7e68964da10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1d74995a6b407698b38e4b74e53556'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:25.773954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1238/2496] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:22:25 2022] DELETE /identity/v3/users/7b1d74995a6b407698b38e4b74e53556 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:22:25.954497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:25.968235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3932aa8-2640-4b78-825f-6cd5872a41d3 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:26.027948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:26.028768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.029261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.029694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] PATH_INFO: `/v3/projects/84da3e824b8c4d018ea577eb2a39213f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.040184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84da3e824b8c4d018ea577eb2a39213f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:26.042185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:26.072777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:22:26.090048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84da3e824b8c4d018ea577eb2a39213f', 'request_id': 'req-c990a561-eb9f-4e05-97be-33c0188d0d36'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:26.097534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84da3e824b8c4d018ea577eb2a39213f', 'request_id': 'req-c990a561-eb9f-4e05-97be-33c0188d0d36'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:26.103147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84da3e824b8c4d018ea577eb2a39213f', 'request_id': 'req-c990a561-eb9f-4e05-97be-33c0188d0d36'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:26.115110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] The token cache is being invalidate because project 84da3e824b8c4d018ea577eb2a39213f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:22:26.115403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:26.116037 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c990a561-eb9f-4e05-97be-33c0188d0d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:22:26.117604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1259/2497] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:22:25 2022] DELETE /identity/v3/projects/84da3e824b8c4d018ea577eb2a39213f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:22:26.123437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522422e2-60bd-4fe3-b4f0-0817c40f6ed2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.123733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522422e2-60bd-4fe3-b4f0-0817c40f6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.124015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522422e2-60bd-4fe3-b4f0-0817c40f6ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.162400 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-522422e2-60bd-4fe3-b4f0-0817c40f6ed2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:26.163603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-522422e2-60bd-4fe3-b4f0-0817c40f6ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:26.223440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1239/2498] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:26.231389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bce9cf-a565-49b8-83ce-97470869b34e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.231681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bce9cf-a565-49b8-83ce-97470869b34e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.231997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bce9cf-a565-49b8-83ce-97470869b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.249966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-04bce9cf-a565-49b8-83ce-97470869b34e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:26.251164 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-04bce9cf-a565-49b8-83ce-97470869b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:26.258897 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1260/2499] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:26.263045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522422e2-60bd-4fe3-b4f0-0817c40f6ed2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:26.273682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522422e2-60bd-4fe3-b4f0-0817c40f6ed2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:26.278247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:26.279475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.279845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.280111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.280851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:22:26.281163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:26.282759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:26.291175 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:22:26.296116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1240/2500] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:22:26.299402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bce9cf-a565-49b8-83ce-97470869b34e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:26.308585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bce9cf-a565-49b8-83ce-97470869b34e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:26.313361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:26.314011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.314299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.314581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.315280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:26.317228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:26.352793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1261/2501] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:22:26 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:22:26.356744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:26.366636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf0789-b6a7-4fe4-86ca-855917bb8140 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:26.424604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:26.425380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.425668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.425945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.426632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:26.428545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:26.449150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1241/2502] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:22:26 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:22:26.453987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:26.464415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74f1a4-ee5f-4d88-acdf-3c5b442bbe73 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:26.469740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:26.470408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.470692 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.470970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.471730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:26.473416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:26.483670 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1262/2503] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:22:26.487588 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:26.498074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd6db3-50c0-4c10-a9e6-c8b4098901b0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:26.502782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41c150-18db-4f9f-936d-7e273ab1a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:26.503438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41c150-18db-4f9f-936d-7e273ab1a6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.503730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41c150-18db-4f9f-936d-7e273ab1a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.504016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41c150-18db-4f9f-936d-7e273ab1a6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.504742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41c150-18db-4f9f-936d-7e273ab1a6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:26.506385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41c150-18db-4f9f-936d-7e273ab1a6dc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:26.517491 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1242/2504] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:22:26.521581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:22:26.531734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d8959-bf3c-4801-aed4-6c5bab0c69ec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:22:26.536221 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:22:26.537122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.537410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.537694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] PATH_INFO: `/v3/projects/c1825387d8124ab8b78ce01f14e93b87/users/de074b9badb74beba921d813aac33c06/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.552709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1825387d8124ab8b78ce01f14e93b87, user_id=de074b9badb74beba921d813aac33c06, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:22:26.555420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:22:26.568867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1263/2505] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:22:26 2022] PUT /identity/v3/projects/c1825387d8124ab8b78ce01f14e93b87/users/de074b9badb74beba921d813aac33c06/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:22:26.579742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6969-4560-4e6b-a4b6-d9e69a9d6cc3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:22:26.580217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6969-4560-4e6b-a4b6-d9e69a9d6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:22:26.580344 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6969-4560-4e6b-a4b6-d9e69a9d6cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:22:26.606221 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6edb6969-4560-4e6b-a4b6-d9e69a9d6cc3 None None] MFA Rules not processed for user `de074b9badb74beba921d813aac33c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:22:26.607528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6edb6969-4560-4e6b-a4b6-d9e69a9d6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:22:26.670815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1243/2506] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:22:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:22:36.564978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=6,keystone:SELECT=45,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:22:36.667775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:26.745312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:26.820421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c466e-2463-4b9e-ba59-e3e4dffc52e6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:26.825046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:26.826469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:26.826826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:26.827109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] PATH_INFO: `/v3/users/de074b9badb74beba921d813aac33c06` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:26.828313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de074b9badb74beba921d813aac33c06)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:26.830290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:26.878443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de074b9badb74beba921d813aac33c06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:26.892117 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de074b9badb74beba921d813aac33c06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:26.900811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de074b9badb74beba921d813aac33c06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:26.910177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de074b9badb74beba921d813aac33c06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:26.910912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de074b9badb74beba921d813aac33c06'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:26.917200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1264/2507] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:23:26 2022] DELETE /identity/v3/users/de074b9badb74beba921d813aac33c06 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:26.922042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599882b-a497-4989-abea-3536fa75390c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:26.922611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599882b-a497-4989-abea-3536fa75390c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:26.922611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599882b-a497-4989-abea-3536fa75390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:26.941145 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c599882b-a497-4989-abea-3536fa75390c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:26.942377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c599882b-a497-4989-abea-3536fa75390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:27.005741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1244/2508] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:27.016363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.017807 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:27.075540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88755f9a-a110-44bc-8954-aa2a1fb7c880 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.079686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7560f-a57b-45f5-aec8-440cd19ffecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.080325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7560f-a57b-45f5-aec8-440cd19ffecb service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.080613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7560f-a57b-45f5-aec8-440cd19ffecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.080921 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7560f-a57b-45f5-aec8-440cd19ffecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.089838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7560f-a57b-45f5-aec8-440cd19ffecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.091259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7560f-a57b-45f5-aec8-440cd19ffecb service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.101365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1265/2509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:23:27.369171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599882b-a497-4989-abea-3536fa75390c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.370656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c599882b-a497-4989-abea-3536fa75390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:27.385690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599882b-a497-4989-abea-3536fa75390c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.392599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.393385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.393701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.393985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] PATH_INFO: `/v3/projects/c1825387d8124ab8b78ce01f14e93b87` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.395936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1825387d8124ab8b78ce01f14e93b87)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.397963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.447358 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1825387d8124ab8b78ce01f14e93b87', 'request_id': 'req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:27.454313 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1825387d8124ab8b78ce01f14e93b87', 'request_id': 'req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:27.460989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1825387d8124ab8b78ce01f14e93b87', 'request_id': 'req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:27.471366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] The token cache is being invalidate because project c1825387d8124ab8b78ce01f14e93b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:23:27.471656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:27.472276 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a6a30d04-a90f-45ed-9b29-f0e0cfb63db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:27.473851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1245/2510] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:23:27 2022] DELETE /identity/v3/projects/c1825387d8124ab8b78ce01f14e93b87 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:27.478660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d427-0cd9-4194-b604-dd32f381256d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.478951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d427-0cd9-4194-b604-dd32f381256d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.479233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d427-0cd9-4194-b604-dd32f381256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.496798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bed9d427-0cd9-4194-b604-dd32f381256d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:27.498651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bed9d427-0cd9-4194-b604-dd32f381256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:27.502786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:27.561130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1266/2511] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:27.570751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2109e-f4a6-4787-82ec-0e8ea5744098 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.571044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2109e-f4a6-4787-82ec-0e8ea5744098 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.571330 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2109e-f4a6-4787-82ec-0e8ea5744098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.590192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-77c2109e-f4a6-4787-82ec-0e8ea5744098 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:27.591380 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-77c2109e-f4a6-4787-82ec-0e8ea5744098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:27.600199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1246/2512] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:23:27.604249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9d427-0cd9-4194-b604-dd32f381256d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.614195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9d427-0cd9-4194-b604-dd32f381256d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.618814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.619466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.619761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.620046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.620774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:23:27.621111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.622778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.634266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1267/2513] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:23:27.638239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2109e-f4a6-4787-82ec-0e8ea5744098 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.647996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2109e-f4a6-4787-82ec-0e8ea5744098 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.653137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.653832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.654953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.655258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.655952 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.657942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.687026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1247/2514] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:23:27 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:27.688111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.698382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155503-bde1-4985-bd75-96e7531a75e1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.759330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.760044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.760367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.760651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.761385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.763904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.783826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1268/2515] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:23:27 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:27.787916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.798132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d79a-4657-4970-86ea-840bc6279176 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.802747 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.803403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.803688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.803971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.804692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.806327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.816632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1248/2516] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:23:27.820367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.830979 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc286524-79b4-4bdd-bda4-ed86d3fea4e7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.835595 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f124b-7632-4de4-8b2e-0314fadd2a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.836252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f124b-7632-4de4-8b2e-0314fadd2a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.836543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f124b-7632-4de4-8b2e-0314fadd2a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.836860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f124b-7632-4de4-8b2e-0314fadd2a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.837583 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f124b-7632-4de4-8b2e-0314fadd2a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.839177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f124b-7632-4de4-8b2e-0314fadd2a4b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.849802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1269/2517] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:27.853797 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:27.863853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe6604-8b5e-4d7d-9822-2a6d4b82d890 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:27.868361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:27.869262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.869547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.869826 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] PATH_INFO: `/v3/projects/0dce5913017e44be8677521e0473da19/users/571eb52f8de74983857f9799dbe2bbcd/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.884346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dce5913017e44be8677521e0473da19, user_id=571eb52f8de74983857f9799dbe2bbcd, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:27.887035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:27.900847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1249/2518] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:23:27 2022] PUT /identity/v3/projects/0dce5913017e44be8677521e0473da19/users/571eb52f8de74983857f9799dbe2bbcd/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:27.911135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0be2c-697e-4035-bf3d-53af4cde6ba8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:27.911427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0be2c-697e-4035-bf3d-53af4cde6ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:27.911739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0be2c-697e-4035-bf3d-53af4cde6ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:27.938875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-75b0be2c-697e-4035-bf3d-53af4cde6ba8 None None] MFA Rules not processed for user `571eb52f8de74983857f9799dbe2bbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:27.940096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-75b0be2c-697e-4035-bf3d-53af4cde6ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:28.004860 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1270/2519] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:23:28.009203 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:28.031100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:28.072378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65742-29ab-4d53-8e97-2757b26ae34c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:28.077759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:28.078405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.078690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.078969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.079641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:28.081589 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:28.105927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1250/2520] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:23:28 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:28.110368 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0be2c-697e-4035-bf3d-53af4cde6ba8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:28.117025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:28.122005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0be2c-697e-4035-bf3d-53af4cde6ba8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:28.178369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:28.179045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.179335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.179625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.180341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:28.182296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:28.202556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1271/2521] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:23:28 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:28.206487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:28.216745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fe55-a0ae-4a85-a7fd-d2fedd69c026 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:28.221541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:28.222196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.222486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.222768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.223492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:28.225137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:28.237118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1251/2522] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:28.241077 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:28.251457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf1900-0ae9-4dcd-85ba-68d76f920cef admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:28.256170 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:28.257025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.257318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.257601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] PATH_INFO: `/v3/projects/031ef2047059480eb0856bf45ee1093b/users/af14de20ba5746bea26c3c64955669c9/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.272247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031ef2047059480eb0856bf45ee1093b, user_id=af14de20ba5746bea26c3c64955669c9, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:28.275296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:28.287469 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1272/2523] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:23:28 2022] PUT /identity/v3/projects/031ef2047059480eb0856bf45ee1093b/users/af14de20ba5746bea26c3c64955669c9/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:23:28.291320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:28.301881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b29ce-17f5-4788-9bd6-0b49eb3a43d1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:28.357986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00724-b3c5-4659-ae2c-299f357de797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:28.358881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00724-b3c5-4659-ae2c-299f357de797 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.359274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00724-b3c5-4659-ae2c-299f357de797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.359647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00724-b3c5-4659-ae2c-299f357de797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.360376 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00724-b3c5-4659-ae2c-299f357de797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:28.362081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00724-b3c5-4659-ae2c-299f357de797 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:28.371804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1252/2524] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:28.376714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:28.386843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602e0c2-5a97-4b3b-8cbe-dd10ebdc8748 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:28.391525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7ea6-e4c4-4727-845f-46764182ded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:28.392398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7ea6-e4c4-4727-845f-46764182ded0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.392687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7ea6-e4c4-4727-845f-46764182ded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.393001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7ea6-e4c4-4727-845f-46764182ded0 admin admin] PATH_INFO: `/v3/projects/031ef2047059480eb0856bf45ee1093b/users/af14de20ba5746bea26c3c64955669c9/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.394976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7ea6-e4c4-4727-845f-46764182ded0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031ef2047059480eb0856bf45ee1093b, user_id=af14de20ba5746bea26c3c64955669c9, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:28.397657 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7ea6-e4c4-4727-845f-46764182ded0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:28.408081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1273/2525] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:23:28 2022] PUT /identity/v3/projects/031ef2047059480eb0856bf45ee1093b/users/af14de20ba5746bea26c3c64955669c9/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:28.418040 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77863d8-f897-4c96-9baa-306cbc6463e8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.418333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77863d8-f897-4c96-9baa-306cbc6463e8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.418625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77863d8-f897-4c96-9baa-306cbc6463e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.445492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d77863d8-f897-4c96-9baa-306cbc6463e8 None None] MFA Rules not processed for user `af14de20ba5746bea26c3c64955669c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:28.446712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d77863d8-f897-4c96-9baa-306cbc6463e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:28.513977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1253/2526] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:28.526337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440293fb-9072-49c2-8829-c33b0819c90e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.526646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440293fb-9072-49c2-8829-c33b0819c90e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.526926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440293fb-9072-49c2-8829-c33b0819c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.575636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-440293fb-9072-49c2-8829-c33b0819c90e None None] MFA Rules not processed for user `473f1bd4a95f4899a4a9a9927f14738c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:28.577016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-440293fb-9072-49c2-8829-c33b0819c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:28.635773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1274/2527] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Jul 21 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:28.641833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77863d8-f897-4c96-9baa-306cbc6463e8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:28.651475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77863d8-f897-4c96-9baa-306cbc6463e8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:28.655652 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:28.656296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:28.656581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:28.656892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:28.668815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:28.714830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:28.716266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:28.725833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1254/2528] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:23:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:23:33.326012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440293fb-9072-49c2-8829-c33b0819c90e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:33.334575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440293fb-9072-49c2-8829-c33b0819c90e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:33.338198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4242d-8dae-4aa7-8c5e-f71a8588dd31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:33.338826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4242d-8dae-4aa7-8c5e-f71a8588dd31 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:33.339109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4242d-8dae-4aa7-8c5e-f71a8588dd31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:33.339384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4242d-8dae-4aa7-8c5e-f71a8588dd31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:33.348510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4242d-8dae-4aa7-8c5e-f71a8588dd31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:33.349991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4242d-8dae-4aa7-8c5e-f71a8588dd31 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:33.359582 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1275/2529] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:23:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:23:38.721870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=21 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:43.355134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:53.968727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:54.032127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816168f-7bed-4650-819f-05f35de7e7f9 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:54.036698 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:54.037593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:54.037879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:54.038155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] PATH_INFO: `/v3/users/571eb52f8de74983857f9799dbe2bbcd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:54.039331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571eb52f8de74983857f9799dbe2bbcd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:54.041294 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:54.087168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571eb52f8de74983857f9799dbe2bbcd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.099420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571eb52f8de74983857f9799dbe2bbcd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.100097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571eb52f8de74983857f9799dbe2bbcd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.106830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571eb52f8de74983857f9799dbe2bbcd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.114213 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571eb52f8de74983857f9799dbe2bbcd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.120767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1255/2530] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:23:53 2022] DELETE /identity/v3/users/571eb52f8de74983857f9799dbe2bbcd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:54.125325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:54.125828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:54.125937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:54.145003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:54.146213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:54.204224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1276/2531] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:54.214640 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:54.216064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:54.274011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486e1dc-62f9-4291-8137-38c6c4a4db26 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:54.277702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:54.278340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:54.278626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:54.278904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:54.287863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:54.289336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:54.298754 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1256/2532] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:23:54.566262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:54.567474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:54.579994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf03e2-667a-4a19-9260-dfdbec9aace0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:54.585548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:54.586420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:54.586732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:54.586997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] PATH_INFO: `/v3/projects/0dce5913017e44be8677521e0473da19` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:54.588195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dce5913017e44be8677521e0473da19)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:54.590185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:54.636603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dce5913017e44be8677521e0473da19', 'request_id': 'req-ff36017c-cc58-4b92-9099-a30bb84a074c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.643128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dce5913017e44be8677521e0473da19', 'request_id': 'req-ff36017c-cc58-4b92-9099-a30bb84a074c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.649862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dce5913017e44be8677521e0473da19', 'request_id': 'req-ff36017c-cc58-4b92-9099-a30bb84a074c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.661994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] The token cache is being invalidate because project 0dce5913017e44be8677521e0473da19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:23:54.662398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.663036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.664566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1277/2533] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:23:54 2022] DELETE /identity/v3/projects/0dce5913017e44be8677521e0473da19 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:54.668654 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:54.678625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcf11-11a8-425d-8e7e-a275609cd6bd service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:54.696910 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:54.737687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:54.738557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:54.738847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:54.739124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] PATH_INFO: `/v3/users/af14de20ba5746bea26c3c64955669c9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:54.740306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af14de20ba5746bea26c3c64955669c9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:54.742334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:54.787246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af14de20ba5746bea26c3c64955669c9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.799038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af14de20ba5746bea26c3c64955669c9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.799755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af14de20ba5746bea26c3c64955669c9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.806149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af14de20ba5746bea26c3c64955669c9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.813058 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c6b15ce-cf15-4ab9-89dd-5a042b46afa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af14de20ba5746bea26c3c64955669c9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:54.819839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1257/2534] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:23:54 2022] DELETE /identity/v3/users/af14de20ba5746bea26c3c64955669c9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:55.084444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.085923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:55.099365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36017c-cc58-4b92-9099-a30bb84a074c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.158080 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.158976 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.159266 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.159548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] PATH_INFO: `/v3/projects/031ef2047059480eb0856bf45ee1093b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.160725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031ef2047059480eb0856bf45ee1093b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.162683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.193396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:55.211519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031ef2047059480eb0856bf45ee1093b', 'request_id': 'req-6e5bd8a3-c655-4666-bce6-13f962a67d95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:55.219437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031ef2047059480eb0856bf45ee1093b', 'request_id': 'req-6e5bd8a3-c655-4666-bce6-13f962a67d95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:55.225793 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031ef2047059480eb0856bf45ee1093b', 'request_id': 'req-6e5bd8a3-c655-4666-bce6-13f962a67d95'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:55.236665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] The token cache is being invalidate because project 031ef2047059480eb0856bf45ee1093b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:23:55.238101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:55.238741 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e5bd8a3-c655-4666-bce6-13f962a67d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:23:55.240264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1278/2535] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:23:55 2022] DELETE /identity/v3/projects/031ef2047059480eb0856bf45ee1093b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:55.245125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a5cae-ecc0-41b4-9397-9d5563e0cc51 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.245592 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a5cae-ecc0-41b4-9397-9d5563e0cc51 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.245711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a5cae-ecc0-41b4-9397-9d5563e0cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.264152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0b8a5cae-ecc0-41b4-9397-9d5563e0cc51 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:55.265310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0b8a5cae-ecc0-41b4-9397-9d5563e0cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:55.323883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1258/2536] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:55.332355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd14c8-85bd-4769-902d-b9c6aa6d0a74 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.332631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd14c8-85bd-4769-902d-b9c6aa6d0a74 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.332959 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd14c8-85bd-4769-902d-b9c6aa6d0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.351935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-85bd14c8-85bd-4769-902d-b9c6aa6d0a74 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:55.353194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-85bd14c8-85bd-4769-902d-b9c6aa6d0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:55.361313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1279/2537] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:55.366197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a5cae-ecc0-41b4-9397-9d5563e0cc51 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.375765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a5cae-ecc0-41b4-9397-9d5563e0cc51 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.381165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.381810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.382094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.382370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.383088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:23:55.383393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.385011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.396374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1259/2538] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:23:55.400888 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd14c8-85bd-4769-902d-b9c6aa6d0a74 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.409965 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd14c8-85bd-4769-902d-b9c6aa6d0a74 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.414525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.415167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.415452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.415728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.416415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.418350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.447000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1280/2539] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:23:55 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:23:55.448979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.459449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368d55-740a-44ff-a8ba-f120f078355b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.486091 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:55.519197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.519789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.520078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.520360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.521084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.523022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.543016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1260/2540] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:23:55 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:55.547330 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.558355 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ce5d-140d-4861-8b74-eed5396fc4e9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.562939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.563591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.563873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.564147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.564901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.566518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.576624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1281/2541] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:55.580610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.590614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff161d-c742-4d29-bb95-ac76c754c6a9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.595273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0e5de-07a9-4897-8402-923f784ad6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.595924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e5de-07a9-4897-8402-923f784ad6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.596211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e5de-07a9-4897-8402-923f784ad6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.597084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e5de-07a9-4897-8402-923f784ad6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.597814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0e5de-07a9-4897-8402-923f784ad6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.599398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0e5de-07a9-4897-8402-923f784ad6c4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.609270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1261/2542] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:55.613881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.623778 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174504-4bb6-4b84-8c74-ac8ebfc3564d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.628571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.629499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.629788 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.630069 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] PATH_INFO: `/v3/projects/570c24d3cd8c41f0a27093b435345780/users/9358b3f563c04342805bf1393e6c82a4/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.644846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570c24d3cd8c41f0a27093b435345780, user_id=9358b3f563c04342805bf1393e6c82a4, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.647506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.661732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1282/2543] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:23:55 2022] PUT /identity/v3/projects/570c24d3cd8c41f0a27093b435345780/users/9358b3f563c04342805bf1393e6c82a4/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:55.671948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05efb3-1a92-4fc8-a233-0fb2f9291fd7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.672190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05efb3-1a92-4fc8-a233-0fb2f9291fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.672474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05efb3-1a92-4fc8-a233-0fb2f9291fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.699738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6e05efb3-1a92-4fc8-a233-0fb2f9291fd7 None None] MFA Rules not processed for user `9358b3f563c04342805bf1393e6c82a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:55.700990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6e05efb3-1a92-4fc8-a233-0fb2f9291fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:55.764549 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1262/2544] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:55.769790 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.831287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc952d98-6ba6-4c73-9445-9613beb1abd7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.836271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.836954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.837247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.837533 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.838228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.840153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.865370 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1283/2545] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:23:55 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:55.869403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05efb3-1a92-4fc8-a233-0fb2f9291fd7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.880872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05efb3-1a92-4fc8-a233-0fb2f9291fd7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.936429 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.937128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.937419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.937707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.938405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.940968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.960465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1263/2546] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:23:55 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:23:55.964601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:55.974944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b742b1-28e0-426b-9afd-696316807333 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:55.979597 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:55.980263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:55.980552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:55.980873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:55.981607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:55.983246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:55.994431 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1284/2547] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:55.998362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.008903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec864d-15f0-4eec-bde4-4e9c1dc3a0a4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.013750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8abbc0-93a1-4be9-aa52-a6b42d82ce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.014440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abbc0-93a1-4be9-aa52-a6b42d82ce96 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.014730 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abbc0-93a1-4be9-aa52-a6b42d82ce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.015017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8abbc0-93a1-4be9-aa52-a6b42d82ce96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.015779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8abbc0-93a1-4be9-aa52-a6b42d82ce96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.017449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8abbc0-93a1-4be9-aa52-a6b42d82ce96 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.027879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1264/2548] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:56.031794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.041770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4e638-efbd-40a5-a5be-72abe84701fa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.046391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.047262 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.047545 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.047826 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] PATH_INFO: `/v3/projects/a7238d8420ee4f3ba85ab846c5637034/users/25262c424cce4d88b0bfede53056e5ba/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.062838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7238d8420ee4f3ba85ab846c5637034, user_id=25262c424cce4d88b0bfede53056e5ba, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.065880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.074344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:56.079261 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1285/2549] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:23:56 2022] PUT /identity/v3/projects/a7238d8420ee4f3ba85ab846c5637034/users/25262c424cce4d88b0bfede53056e5ba/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:56.140373 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915461-5ee4-46b5-bb43-60fa651ca7ea None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.140664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915461-5ee4-46b5-bb43-60fa651ca7ea None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.140979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915461-5ee4-46b5-bb43-60fa651ca7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.168170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-63915461-5ee4-46b5-bb43-60fa651ca7ea None None] MFA Rules not processed for user `25262c424cce4d88b0bfede53056e5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:56.169405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-63915461-5ee4-46b5-bb43-60fa651ca7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:56.173309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:56.234743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1265/2550] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:56.239231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.305038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998cd23-98c0-4396-bc8e-0656d3ac6c36 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.309677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.310340 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.310632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.310934 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.311616 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.313579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.339732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1286/2551] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:23:56 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:56.343775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63915461-5ee4-46b5-bb43-60fa651ca7ea None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.354476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63915461-5ee4-46b5-bb43-60fa651ca7ea None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.410737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.411391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.411679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.411962 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.412646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.414606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.434353 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1266/2552] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:23:56 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:23:56.438348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.449239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c79540-0afc-4252-b5b4-494d899bc6bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.453775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.454426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.454708 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.454985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.456791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.458430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.468961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1287/2553] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:56.473044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.483318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cf2d4-ed8d-4aea-b374-f303e098f7bd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.488516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.489417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.489702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.489979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] PATH_INFO: `/v3/projects/cad5e4cd333e4df3825321c41ea2a71c/users/61c259e6d7904323b8f937967e6819b7/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.505299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad5e4cd333e4df3825321c41ea2a71c, user_id=61c259e6d7904323b8f937967e6819b7, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.507955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.521311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1267/2554] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:23:56 2022] PUT /identity/v3/projects/cad5e4cd333e4df3825321c41ea2a71c/users/61c259e6d7904323b8f937967e6819b7/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:56.525602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.535598 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb17ee-64f4-439e-b87f-7947302540b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.591553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cae82-60aa-49c7-9c51-5a6d267d5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.592149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cae82-60aa-49c7-9c51-5a6d267d5c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.592438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cae82-60aa-49c7-9c51-5a6d267d5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.592720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cae82-60aa-49c7-9c51-5a6d267d5c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.593481 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cae82-60aa-49c7-9c51-5a6d267d5c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.595096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cae82-60aa-49c7-9c51-5a6d267d5c70 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.605000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1288/2555] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:23:56.609267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.619915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef153cb7-fe9a-426f-8265-69a6e2485911 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.624506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.625477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.625762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.626046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] PATH_INFO: `/v3/projects/cad5e4cd333e4df3825321c41ea2a71c/users/61c259e6d7904323b8f937967e6819b7/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.628776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad5e4cd333e4df3825321c41ea2a71c, user_id=61c259e6d7904323b8f937967e6819b7, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.631434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.641551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1268/2556] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:23:56 2022] PUT /identity/v3/projects/cad5e4cd333e4df3825321c41ea2a71c/users/61c259e6d7904323b8f937967e6819b7/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:23:56.651873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdbe42-d83b-4ee2-8baf-d7b9e314c9c2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.652371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdbe42-d83b-4ee2-8baf-d7b9e314c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.652660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdbe42-d83b-4ee2-8baf-d7b9e314c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.680092 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-27fdbe42-d83b-4ee2-8baf-d7b9e314c9c2 None None] MFA Rules not processed for user `61c259e6d7904323b8f937967e6819b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:56.681338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27fdbe42-d83b-4ee2-8baf-d7b9e314c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:56.741994 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:56.751522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1289/2557] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:23:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:56.762673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:56.764383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:56.820726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cedad4-2b4d-4927-8f05-dc66c9475004 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:56.824385 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:56.825053 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:56.825342 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:56.825625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:56.834547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:56.835972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:56.840912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:23:56.845974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1269/2558] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:23:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:23:57.324318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ceef9-6b4a-4dca-93b0-b615f4d2af31 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:57.324843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ceef9-6b4a-4dca-93b0-b615f4d2af31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:57.324955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ceef9-6b4a-4dca-93b0-b615f4d2af31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:57.342615 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f62ceef9-6b4a-4dca-93b0-b615f4d2af31 None None] MFA Rules not processed for user `473f1bd4a95f4899a4a9a9927f14738c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:23:57.343823 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f62ceef9-6b4a-4dca-93b0-b615f4d2af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:23:57.350985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1290/2559] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Jul 21 05:23:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:23:57.356868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:23:57.366055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef6c5-8d1d-4636-8e54-8de094d039a7 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:23:57.369783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:23:57.370417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:23:57.370706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:23:57.370993 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:23:57.429613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:23:57.431130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:23:57.440237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1270/2560] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:23:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:01.417691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ceef9-6b4a-4dca-93b0-b615f4d2af31 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:01.427032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ceef9-6b4a-4dca-93b0-b615f4d2af31 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:01.430666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fea77-227e-42de-9b25-006d9dbac0d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:01.431339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fea77-227e-42de-9b25-006d9dbac0d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:01.431624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fea77-227e-42de-9b25-006d9dbac0d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:01.431899 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fea77-227e-42de-9b25-006d9dbac0d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:01.488743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fea77-227e-42de-9b25-006d9dbac0d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:01.490208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fea77-227e-42de-9b25-006d9dbac0d9 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:01.499351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1291/2561] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:03.542288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:03.604460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd98dc2-8ae9-470d-b30e-ad56e7b2748f service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:03.609016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:03.609813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:03.610094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:03.610370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] PATH_INFO: `/v3/users/9358b3f563c04342805bf1393e6c82a4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:03.611542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9358b3f563c04342805bf1393e6c82a4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:03.614368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:03.661479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9358b3f563c04342805bf1393e6c82a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:03.673936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9358b3f563c04342805bf1393e6c82a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:03.674629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9358b3f563c04342805bf1393e6c82a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:03.682568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9358b3f563c04342805bf1393e6c82a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:03.689412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9358b3f563c04342805bf1393e6c82a4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:03.695964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1271/2562] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:24:03 2022] DELETE /identity/v3/users/9358b3f563c04342805bf1393e6c82a4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:03.700551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:03.701044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:03.701169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:03.718165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:03.719362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:03.778662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1292/2563] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:03.788751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:03.790181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:03.810537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:03.848248 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e486858-e792-44ed-bb23-8985453d79b0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:03.851828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:03.852465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:03.852746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:03.853046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:03.861908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:03.864141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:03.873522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1272/2564] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:04.139331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:04.140854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:04.153789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbaee8-69f1-4061-b503-fe4fccb798da None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:04.158417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:04.159988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:04.160296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:04.160542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] PATH_INFO: `/v3/projects/570c24d3cd8c41f0a27093b435345780` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:04.161840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570c24d3cd8c41f0a27093b435345780)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:04.163789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:04.210524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570c24d3cd8c41f0a27093b435345780', 'request_id': 'req-2e2607a7-779d-4e13-b295-da95173356b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.217217 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570c24d3cd8c41f0a27093b435345780', 'request_id': 'req-2e2607a7-779d-4e13-b295-da95173356b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.223222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570c24d3cd8c41f0a27093b435345780', 'request_id': 'req-2e2607a7-779d-4e13-b295-da95173356b7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.233878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] The token cache is being invalidate because project 570c24d3cd8c41f0a27093b435345780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:24:04.234163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.234783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.236298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1293/2565] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:24:04 2022] DELETE /identity/v3/projects/570c24d3cd8c41f0a27093b435345780 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:04.240664 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:04.250416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa86a9-793d-4af3-9422-930a2e514dab service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:04.307186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:04.308055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:04.308338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:04.308616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] PATH_INFO: `/v3/users/25262c424cce4d88b0bfede53056e5ba` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:04.309831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25262c424cce4d88b0bfede53056e5ba)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:04.311745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:04.356339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25262c424cce4d88b0bfede53056e5ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.367845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25262c424cce4d88b0bfede53056e5ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.368505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25262c424cce4d88b0bfede53056e5ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.375505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25262c424cce4d88b0bfede53056e5ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.382805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25262c424cce4d88b0bfede53056e5ba'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.388714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1273/2566] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:24:04 2022] DELETE /identity/v3/users/25262c424cce4d88b0bfede53056e5ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:04.673056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:04.674511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:04.687570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2607a7-779d-4e13-b295-da95173356b7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:04.696547 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:04.747062 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:04.747918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:04.748202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:04.748479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] PATH_INFO: `/v3/projects/a7238d8420ee4f3ba85ab846c5637034` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:04.749675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7238d8420ee4f3ba85ab846c5637034)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:04.751588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:04.796570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7238d8420ee4f3ba85ab846c5637034', 'request_id': 'req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.803866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7238d8420ee4f3ba85ab846c5637034', 'request_id': 'req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.809320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7238d8420ee4f3ba85ab846c5637034', 'request_id': 'req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.820685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] The token cache is being invalidate because project a7238d8420ee4f3ba85ab846c5637034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:24:04.821001 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.821630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.823155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1294/2567] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:24:04 2022] DELETE /identity/v3/projects/a7238d8420ee4f3ba85ab846c5637034 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:04.827299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:04.828720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:04.842082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b453e-3c3c-4c26-a87e-865d123c9869 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:04.879320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:04.900077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:04.900982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:04.901268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:04.901542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] PATH_INFO: `/v3/users/61c259e6d7904323b8f937967e6819b7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:04.902727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c259e6d7904323b8f937967e6819b7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:04.904651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:04.950193 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c259e6d7904323b8f937967e6819b7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.962740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c259e6d7904323b8f937967e6819b7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.963407 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c259e6d7904323b8f937967e6819b7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.970680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c259e6d7904323b8f937967e6819b7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.978616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-8e205470-3d90-4f2b-87fc-4f767ae30de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c259e6d7904323b8f937967e6819b7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:04.984441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1274/2568] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:24:04 2022] DELETE /identity/v3/users/61c259e6d7904323b8f937967e6819b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:05.255450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.256969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:05.271805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712bd19-6c6a-4b97-ae06-3dcdd33a89ad admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:05.331649 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:05.332513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.332798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.333099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] PATH_INFO: `/v3/projects/cad5e4cd333e4df3825321c41ea2a71c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.334286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad5e4cd333e4df3825321c41ea2a71c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:05.336226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:05.379828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:05.384514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad5e4cd333e4df3825321c41ea2a71c', 'request_id': 'req-a2172970-efee-416a-8fcc-99e31b939f31'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:05.392954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad5e4cd333e4df3825321c41ea2a71c', 'request_id': 'req-a2172970-efee-416a-8fcc-99e31b939f31'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:05.399629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad5e4cd333e4df3825321c41ea2a71c', 'request_id': 'req-a2172970-efee-416a-8fcc-99e31b939f31'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:05.410585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] The token cache is being invalidate because project cad5e4cd333e4df3825321c41ea2a71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:24:05.410872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:05.411501 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a2172970-efee-416a-8fcc-99e31b939f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:05.413197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1295/2569] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:24:05 2022] DELETE /identity/v3/projects/cad5e4cd333e4df3825321c41ea2a71c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:05.419154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a11c6-21d4-4b58-b5b6-7b99df8e6c7a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.419458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a11c6-21d4-4b58-b5b6-7b99df8e6c7a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.419777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a11c6-21d4-4b58-b5b6-7b99df8e6c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.437613 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7d1a11c6-21d4-4b58-b5b6-7b99df8e6c7a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:05.438822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7d1a11c6-21d4-4b58-b5b6-7b99df8e6c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:05.496842 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1275/2570] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:05.507147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf074-9d0a-4b1d-b62e-ecdd9f267a18 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.507439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf074-9d0a-4b1d-b62e-ecdd9f267a18 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.507719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf074-9d0a-4b1d-b62e-ecdd9f267a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.527052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0eabf074-9d0a-4b1d-b62e-ecdd9f267a18 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:05.528298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0eabf074-9d0a-4b1d-b62e-ecdd9f267a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:05.536487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1296/2571] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:05.540714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a11c6-21d4-4b58-b5b6-7b99df8e6c7a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.550666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a11c6-21d4-4b58-b5b6-7b99df8e6c7a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:05.555314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:05.555969 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.556258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.556541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.557309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:24:05.557622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:05.559245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:05.571456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1276/2572] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:24:05.575722 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf074-9d0a-4b1d-b62e-ecdd9f267a18 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.585846 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf074-9d0a-4b1d-b62e-ecdd9f267a18 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:05.590443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:05.591095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.591385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.591665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.592350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:05.594280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:05.620247 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1297/2573] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:24:05 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:24:05.624112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.634767 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b029a-b2f5-4cb3-ab61-9bdb867f485f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:05.678850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:05.693703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:05.694368 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.694655 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.694933 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.695631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:05.697595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:05.716310 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1277/2574] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:24:05 2022] POST /identity/v3/users => generated 277 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:24:05.720631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.730961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557923ce-f7bd-4b17-92ad-2f3e160d053f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:05.735969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:05.736653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.736961 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.737783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.738554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:05.740166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:05.750661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1298/2575] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:05.755339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.765172 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f7deb-3bc1-4547-b93f-eda481324002 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:05.769748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69707a-c434-41a0-a672-2106e6e30bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:05.770394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69707a-c434-41a0-a672-2106e6e30bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.770677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69707a-c434-41a0-a672-2106e6e30bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.770958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69707a-c434-41a0-a672-2106e6e30bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.771673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69707a-c434-41a0-a672-2106e6e30bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:05.773305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69707a-c434-41a0-a672-2106e6e30bf0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:05.783505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1278/2576] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:05.787683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.797721 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30848-c20f-4139-8f8a-75610949a5e6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:05.803627 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:05.804593 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.804980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.805328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] PATH_INFO: `/v3/projects/7fb68ed13e9b4fc59be9e136fe0eaffc/users/e1170b47a9a74ab0b0cfd123541fd7be/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.821797 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb68ed13e9b4fc59be9e136fe0eaffc, user_id=e1170b47a9a74ab0b0cfd123541fd7be, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:05.824559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:05.838936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1299/2577] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:24:05 2022] PUT /identity/v3/projects/7fb68ed13e9b4fc59be9e136fe0eaffc/users/e1170b47a9a74ab0b0cfd123541fd7be/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:24:05.850505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a95c1-e7e1-4f13-8296-7cbd0727c0bb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:05.851057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a95c1-e7e1-4f13-8296-7cbd0727c0bb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:05.851208 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a95c1-e7e1-4f13-8296-7cbd0727c0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:05.879673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-177a95c1-e7e1-4f13-8296-7cbd0727c0bb None None] MFA Rules not processed for user `e1170b47a9a74ab0b0cfd123541fd7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:05.881004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-177a95c1-e7e1-4f13-8296-7cbd0727c0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:05.949326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1279/2578] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:05 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:05.980740 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:05.982512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:06.043771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537bf7f-bf49-4147-87e1-c200f2647e0d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:06.048003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbc2be-de61-478c-b4cd-991c6eaf1779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:06.048659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbc2be-de61-478c-b4cd-991c6eaf1779 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.048993 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbc2be-de61-478c-b4cd-991c6eaf1779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.049275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbc2be-de61-478c-b4cd-991c6eaf1779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.060771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbc2be-de61-478c-b4cd-991c6eaf1779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:06.062250 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbc2be-de61-478c-b4cd-991c6eaf1779 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:06.071479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1300/2579] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:05 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:06.085701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a95c1-e7e1-4f13-8296-7cbd0727c0bb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:06.147107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a95c1-e7e1-4f13-8296-7cbd0727c0bb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:06.151941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:06.152805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.153116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.153446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] PATH_INFO: `/v3/users/e1170b47a9a74ab0b0cfd123541fd7be` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.154659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1170b47a9a74ab0b0cfd123541fd7be)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:06.156600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:06.207610 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1170b47a9a74ab0b0cfd123541fd7be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.214796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:06.221114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1170b47a9a74ab0b0cfd123541fd7be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.222876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1170b47a9a74ab0b0cfd123541fd7be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.230171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1170b47a9a74ab0b0cfd123541fd7be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.238138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1170b47a9a74ab0b0cfd123541fd7be'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.244232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1280/2580] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:24:06 2022] DELETE /identity/v3/users/e1170b47a9a74ab0b0cfd123541fd7be => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:06.249409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.249706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.249996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.273142 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:06.274646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:06.338620 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1301/2581] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:24:06.348297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:06.349851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:06.409235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aec320-a407-4d74-8653-79676a170e9c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:06.413108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1696c3-8adf-42bd-9d21-e647bdc461a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:06.413758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1696c3-8adf-42bd-9d21-e647bdc461a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.414043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1696c3-8adf-42bd-9d21-e647bdc461a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.414323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1696c3-8adf-42bd-9d21-e647bdc461a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.423678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1696c3-8adf-42bd-9d21-e647bdc461a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:06.425972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1696c3-8adf-42bd-9d21-e647bdc461a9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:06.435726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1281/2582] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:06.711865 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:06.713854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:06.727827 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47265bfb-8c2a-4aa7-b21f-62a0101e570e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:06.733062 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:06.734265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.734698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.734918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] PATH_INFO: `/v3/projects/7fb68ed13e9b4fc59be9e136fe0eaffc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.736388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb68ed13e9b4fc59be9e136fe0eaffc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:06.738390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:06.746758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:06.792650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb68ed13e9b4fc59be9e136fe0eaffc', 'request_id': 'req-4afca840-027c-4266-8a5b-5ecde12b97fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.799259 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb68ed13e9b4fc59be9e136fe0eaffc', 'request_id': 'req-4afca840-027c-4266-8a5b-5ecde12b97fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.804905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb68ed13e9b4fc59be9e136fe0eaffc', 'request_id': 'req-4afca840-027c-4266-8a5b-5ecde12b97fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.816531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] The token cache is being invalidate because project 7fb68ed13e9b4fc59be9e136fe0eaffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:24:06.816815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.817484 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4afca840-027c-4266-8a5b-5ecde12b97fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:06.819017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1302/2583] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:24:06 2022] DELETE /identity/v3/projects/7fb68ed13e9b4fc59be9e136fe0eaffc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:06.823874 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f5d2-d47c-4a39-808d-ef5312866f33 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.824157 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f5d2-d47c-4a39-808d-ef5312866f33 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.824443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f5d2-d47c-4a39-808d-ef5312866f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.842776 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ac56f5d2-d47c-4a39-808d-ef5312866f33 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:06.843972 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ac56f5d2-d47c-4a39-808d-ef5312866f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:06.903599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1282/2584] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:06.911256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aacfcb-c7c8-445a-9f29-9ef46fd1fc6d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.911552 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aacfcb-c7c8-445a-9f29-9ef46fd1fc6d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.911833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aacfcb-c7c8-445a-9f29-9ef46fd1fc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.930103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a1aacfcb-c7c8-445a-9f29-9ef46fd1fc6d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:06.931304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a1aacfcb-c7c8-445a-9f29-9ef46fd1fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:06.939179 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1303/2585] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:06.943778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f5d2-d47c-4a39-808d-ef5312866f33 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:06.953615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f5d2-d47c-4a39-808d-ef5312866f33 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:06.958971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:06.959622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.959907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.960187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.960954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:24:06.961268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:06.962879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:06.978052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1283/2586] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:24:06.982407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aacfcb-c7c8-445a-9f29-9ef46fd1fc6d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:06.991613 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aacfcb-c7c8-445a-9f29-9ef46fd1fc6d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:06.996369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:06.997041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:06.997325 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:06.997603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:06.998308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.000197 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.027751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1304/2587] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:24:06 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:24:07.030798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.040775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17dee-b30f-40ec-98c0-55d4d05e10dc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.096218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.096955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.097321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.097603 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.098292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.100218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.108668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:07.121595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1284/2588] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:24:07 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:24:07.125816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.136567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0af8-0d22-4937-ad0b-20ab2f7dfb0f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.141183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.141834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.142116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.142392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.143115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.145016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.155531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1305/2589] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:24:07.159785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.169672 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bcfa0-5f0e-417c-839d-4f0d7d1a43e0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.174255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d45974-94da-4313-9a9f-4c364ac64b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.175553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45974-94da-4313-9a9f-4c364ac64b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.175840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45974-94da-4313-9a9f-4c364ac64b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.176118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45974-94da-4313-9a9f-4c364ac64b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.176901 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d45974-94da-4313-9a9f-4c364ac64b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.178528 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d45974-94da-4313-9a9f-4c364ac64b36 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.188327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1285/2590] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:07.193316 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.203029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a1c02-92d3-47e4-980e-9795591585c0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.207744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.208612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.208928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.209212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] PATH_INFO: `/v3/projects/a37b1f57cbd148a1a5a614da600fdeee/users/88c374f139ab447c815623d9a41e4bc5/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.223486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37b1f57cbd148a1a5a614da600fdeee, user_id=88c374f139ab447c815623d9a41e4bc5, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.226148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.239495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1306/2591] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:24:07 2022] PUT /identity/v3/projects/a37b1f57cbd148a1a5a614da600fdeee/users/88c374f139ab447c815623d9a41e4bc5/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:07.250734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ad982-b6bf-4065-a733-294dda18c62d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.251039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ad982-b6bf-4065-a733-294dda18c62d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.251324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ad982-b6bf-4065-a733-294dda18c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.277980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fb3ad982-b6bf-4065-a733-294dda18c62d None None] MFA Rules not processed for user `88c374f139ab447c815623d9a41e4bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:07.279202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb3ad982-b6bf-4065-a733-294dda18c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:07.343314 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1286/2592] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:07.348122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.412462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e307c-8e14-4ffe-b7e5-d3a4048f574a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.417375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.418048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.418339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.418623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.419329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.421313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.446618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1307/2593] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:24:07 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:24:07.450813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ad982-b6bf-4065-a733-294dda18c62d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.461586 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ad982-b6bf-4065-a733-294dda18c62d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.517743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.518476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.518900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.519018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.519704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.521677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.542299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1287/2594] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:24:07 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:24:07.546348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.563044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdc575-da77-4cc0-b086-e477e78e51af admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.567911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.568571 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.568890 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.569173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.569896 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.571491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.582767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1308/2595] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:07.586813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.597858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeb54d-c96a-4aa1-b04b-6f534c3b456d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.602624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08149c5c-4fea-4f16-b261-b5ca6d03f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.603218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149c5c-4fea-4f16-b261-b5ca6d03f30d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.603506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149c5c-4fea-4f16-b261-b5ca6d03f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.603786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149c5c-4fea-4f16-b261-b5ca6d03f30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.604510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08149c5c-4fea-4f16-b261-b5ca6d03f30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.606151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08149c5c-4fea-4f16-b261-b5ca6d03f30d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.616593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1288/2596] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:07.620666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.626969 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:07.631258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beafb5-2e02-4fa9-a066-164e5e5cb8ab admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.637411 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.638342 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.638677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.639173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] PATH_INFO: `/v3/projects/9d800c481c9f45dab490da1866da3909/users/96cb0254848a4a1a800bbdae2eb33c46/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.654493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d800c481c9f45dab490da1866da3909, user_id=96cb0254848a4a1a800bbdae2eb33c46, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.657202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.670710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1309/2597] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:24:07 2022] PUT /identity/v3/projects/9d800c481c9f45dab490da1866da3909/users/96cb0254848a4a1a800bbdae2eb33c46/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:24:07.681904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc5fc-ca47-48e2-a897-c218903e1d77 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.682203 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc5fc-ca47-48e2-a897-c218903e1d77 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.682492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddc5fc-ca47-48e2-a897-c218903e1d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.708543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a9ddc5fc-ca47-48e2-a897-c218903e1d77 None None] MFA Rules not processed for user `96cb0254848a4a1a800bbdae2eb33c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:07.709800 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a9ddc5fc-ca47-48e2-a897-c218903e1d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:07.749851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:07.775223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1289/2598] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:07.779715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.840509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dea07-1810-456d-8c90-ea0fe8d5277a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.845141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.845789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.846072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.846347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.847511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.849445 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.874208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1310/2599] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:24:07 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:24:07.878576 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddc5fc-ca47-48e2-a897-c218903e1d77 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.889218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddc5fc-ca47-48e2-a897-c218903e1d77 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.947171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.947828 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.948111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.948395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.949190 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.951033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:07.972419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1290/2600] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:24:07 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:24:07.976564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:07.986839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e04-a266-41ee-8b54-94b7563a8afb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:07.991864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:07.992541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:07.992841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:07.993147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:07.993991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:07.995587 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:08.006151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1311/2601] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:08.010133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:08.020879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc1c9b-7459-4707-9604-c25e4a064575 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:08.025768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:08.026633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:08.026916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:08.027193 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] PATH_INFO: `/v3/projects/534cd39cd17242b7ac4ab92e5030d601/users/580f6f7580a04025b615c7f52f95c316/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:08.042401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] RBAC: Authorizing `identity:create_grant(project_id=534cd39cd17242b7ac4ab92e5030d601, user_id=580f6f7580a04025b615c7f52f95c316, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:08.045102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:08.057635 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1291/2602] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:24:08 2022] PUT /identity/v3/projects/534cd39cd17242b7ac4ab92e5030d601/users/580f6f7580a04025b615c7f52f95c316/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:08.061459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:08.071344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14561830-f3fa-4db6-a759-73b87d6796af admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:08.128496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0c2e9-a1ec-4c4e-8d89-b8b857b85d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:08.129111 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c2e9-a1ec-4c4e-8d89-b8b857b85d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:08.129403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c2e9-a1ec-4c4e-8d89-b8b857b85d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:08.129685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c2e9-a1ec-4c4e-8d89-b8b857b85d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:08.130408 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c2e9-a1ec-4c4e-8d89-b8b857b85d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:08.132004 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c2e9-a1ec-4c4e-8d89-b8b857b85d5f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:08.141643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1312/2603] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:08.146366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:08.156781 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9eda9-59e2-441f-8023-ea5b0cdd76df admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:08.162349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:08.163233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:08.163517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:08.163793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] PATH_INFO: `/v3/projects/534cd39cd17242b7ac4ab92e5030d601/users/580f6f7580a04025b615c7f52f95c316/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:08.165830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534cd39cd17242b7ac4ab92e5030d601, user_id=580f6f7580a04025b615c7f52f95c316, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:08.168480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:08.178725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1292/2604] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:24:08 2022] PUT /identity/v3/projects/534cd39cd17242b7ac4ab92e5030d601/users/580f6f7580a04025b615c7f52f95c316/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:08.188585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:08.188917 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:08.189207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:08.217313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] MFA Rules not processed for user `580f6f7580a04025b615c7f52f95c316`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:08.218529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:08.258661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:08.288376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1313/2605] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:08.299756 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:08.301702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:08.359209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83846738-4549-402c-bb3e-95b0ab447323 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:08.363022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:08.363661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:08.363945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:08.364225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:08.408643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:08.421394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:08.422849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:08.431834 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1293/2606] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:09.917494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:09.918937 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:09.930879 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19688c-8598-445c-90e1-9f170708abe9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:09.934307 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:09.934943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:09.935228 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:09.935510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:09.991565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:09.993025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:10.001838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1314/2607] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:10.509731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:10.518070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863db7-b2cb-4c18-9651-11723450407b service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:10.522036 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e97d9-0cc5-42e1-a4d8-02976c98727f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:10.522673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e97d9-0cc5-42e1-a4d8-02976c98727f service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:10.522960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e97d9-0cc5-42e1-a4d8-02976c98727f service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:10.523244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e97d9-0cc5-42e1-a4d8-02976c98727f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:10.532411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e97d9-0cc5-42e1-a4d8-02976c98727f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:10.534411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e97d9-0cc5-42e1-a4d8-02976c98727f service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:10.544048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1294/2608] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:14.367904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:14.429534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec26c-09af-42be-a173-87b72da49f5c service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:14.434047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:14.434909 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:14.435192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:14.435480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] PATH_INFO: `/v3/users/88c374f139ab447c815623d9a41e4bc5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:14.436642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c374f139ab447c815623d9a41e4bc5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:14.438601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:14.484210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c374f139ab447c815623d9a41e4bc5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:14.496186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c374f139ab447c815623d9a41e4bc5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:14.503009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c374f139ab447c815623d9a41e4bc5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:14.507905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:14.512213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c374f139ab447c815623d9a41e4bc5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:14.513127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c374f139ab447c815623d9a41e4bc5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:14.520536 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1315/2609] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:24:14 2022] DELETE /identity/v3/users/88c374f139ab447c815623d9a41e4bc5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:14.525521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:14.526009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:14.526123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:14.543693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:14.544942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:14.602573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1295/2610] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:14.612789 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:14.614213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:14.670676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ceab-46ef-4d71-af43-892285ca7540 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:14.674955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:14.675684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:14.675968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:14.676245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:14.685218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:14.686651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:14.696804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1316/2611] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:14.964624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:14.966331 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:14.980617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3561c73-2974-48d9-87d8-0a4ded561e44 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:14.985808 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:14.986987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:14.988152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:14.988644 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] PATH_INFO: `/v3/projects/a37b1f57cbd148a1a5a614da600fdeee` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:14.989968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37b1f57cbd148a1a5a614da600fdeee)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:14.991918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:15.039702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37b1f57cbd148a1a5a614da600fdeee', 'request_id': 'req-4142cdf7-fee3-414b-bc7f-aeb96295dab6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.046054 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37b1f57cbd148a1a5a614da600fdeee', 'request_id': 'req-4142cdf7-fee3-414b-bc7f-aeb96295dab6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.054093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37b1f57cbd148a1a5a614da600fdeee', 'request_id': 'req-4142cdf7-fee3-414b-bc7f-aeb96295dab6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.064634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] The token cache is being invalidate because project a37b1f57cbd148a1a5a614da600fdeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:24:15.064961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.065643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.067210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1296/2612] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:24:14 2022] DELETE /identity/v3/projects/a37b1f57cbd148a1a5a614da600fdeee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:15.071162 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:15.080884 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff4a1-5ffc-428e-bf45-a1f5a856c84a service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:15.142233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:15.143066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:15.143362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:15.143676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] PATH_INFO: `/v3/users/96cb0254848a4a1a800bbdae2eb33c46` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:15.144893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cb0254848a4a1a800bbdae2eb33c46)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:15.146832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:15.193204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cb0254848a4a1a800bbdae2eb33c46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.205188 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cb0254848a4a1a800bbdae2eb33c46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.212527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cb0254848a4a1a800bbdae2eb33c46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.219523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cb0254848a4a1a800bbdae2eb33c46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.220156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cb0254848a4a1a800bbdae2eb33c46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.226760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1317/2613] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:24:15 2022] DELETE /identity/v3/users/96cb0254848a4a1a800bbdae2eb33c46 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:15.495509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:15.497123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:15.510785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142cdf7-fee3-414b-bc7f-aeb96295dab6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:15.561388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:15.568080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:15.568982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:15.569597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:15.569931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] PATH_INFO: `/v3/projects/9d800c481c9f45dab490da1866da3909` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:15.571129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d800c481c9f45dab490da1866da3909)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:15.573486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:15.619555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d800c481c9f45dab490da1866da3909', 'request_id': 'req-5083b081-0613-4971-a520-1a3b7dbdf83c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.625547 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d800c481c9f45dab490da1866da3909', 'request_id': 'req-5083b081-0613-4971-a520-1a3b7dbdf83c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.632650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d800c481c9f45dab490da1866da3909', 'request_id': 'req-5083b081-0613-4971-a520-1a3b7dbdf83c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.643546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] The token cache is being invalidate because project 9d800c481c9f45dab490da1866da3909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:24:15.643794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.644468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.646061 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1297/2614] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:24:15 2022] DELETE /identity/v3/projects/9d800c481c9f45dab490da1866da3909 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:15.650243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:15.651719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:15.665502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4219483-d753-4a5e-99e2-1994f8ec41d0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:15.677013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:15.723914 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:15.724787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:15.725109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:15.725392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] PATH_INFO: `/v3/users/580f6f7580a04025b615c7f52f95c316` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:15.726591 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580f6f7580a04025b615c7f52f95c316)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:15.728540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:15.774246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580f6f7580a04025b615c7f52f95c316'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.785796 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580f6f7580a04025b615c7f52f95c316'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.792760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580f6f7580a04025b615c7f52f95c316'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.800207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580f6f7580a04025b615c7f52f95c316'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.800918 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-63001248-1048-4d3c-be19-32532be59546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580f6f7580a04025b615c7f52f95c316'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:15.806881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1318/2615] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:24:15 2022] DELETE /identity/v3/users/580f6f7580a04025b615c7f52f95c316 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:16.078886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.080433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:16.094515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083b081-0613-4971-a520-1a3b7dbdf83c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.152807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.153701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.153985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.154261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] PATH_INFO: `/v3/projects/534cd39cd17242b7ac4ab92e5030d601` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.155418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=534cd39cd17242b7ac4ab92e5030d601)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.157365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.203794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534cd39cd17242b7ac4ab92e5030d601', 'request_id': 'req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:16.209895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534cd39cd17242b7ac4ab92e5030d601', 'request_id': 'req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:16.217759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534cd39cd17242b7ac4ab92e5030d601', 'request_id': 'req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:16.228362 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] The token cache is being invalidate because project 534cd39cd17242b7ac4ab92e5030d601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:24:16.228657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:16.229408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-18fe27f2-6fe7-429c-b1a3-677df0cf6b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:24:16.230928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1298/2616] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:24:16 2022] DELETE /identity/v3/projects/534cd39cd17242b7ac4ab92e5030d601 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:16.235819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ceec-188f-419c-8786-450eaa0a0a8f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.236109 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ceec-188f-419c-8786-450eaa0a0a8f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.236393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ceec-188f-419c-8786-450eaa0a0a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.255686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-baa5ceec-188f-419c-8786-450eaa0a0a8f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:16.256924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-baa5ceec-188f-419c-8786-450eaa0a0a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:16.320986 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1319/2617] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:16.328740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb11d-9ff1-4cc2-8722-f0a31cc58d4e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.329084 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb11d-9ff1-4cc2-8722-f0a31cc58d4e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.329411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb11d-9ff1-4cc2-8722-f0a31cc58d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.347612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e7fbb11d-9ff1-4cc2-8722-f0a31cc58d4e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:16.348861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e7fbb11d-9ff1-4cc2-8722-f0a31cc58d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:16.356907 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1299/2618] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:16.361003 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ceec-188f-419c-8786-450eaa0a0a8f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.371467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ceec-188f-419c-8786-450eaa0a0a8f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.376083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.376735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.377055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.377344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.378362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:24:16.378675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.380291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.391781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1320/2619] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:24:16.396525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbb11d-9ff1-4cc2-8722-f0a31cc58d4e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.406032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbb11d-9ff1-4cc2-8722-f0a31cc58d4e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.411341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.411986 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.412272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.412554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.413286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.415187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.423364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:16.444687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1300/2620] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:24:16 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:24:16.448861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.460141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660087c-0879-4b8e-8203-b920cd8d88c3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.480371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:16.519744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.520404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.520689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.521096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.521684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.523857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.543361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1321/2621] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:24:16 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:24:16.547564 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.558035 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854c602-efa9-40d8-82de-5a1945378b1e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.562692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.563350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.563636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.563948 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.564673 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.566947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.577346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1301/2622] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:16.581858 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.591694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b52c-4f77-460e-86a7-7c9222dcf6c2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.596322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601116db-b433-4b45-855e-9a7a01b81ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.597148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601116db-b433-4b45-855e-9a7a01b81ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.597439 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601116db-b433-4b45-855e-9a7a01b81ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.597726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601116db-b433-4b45-855e-9a7a01b81ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.598456 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601116db-b433-4b45-855e-9a7a01b81ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.600041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601116db-b433-4b45-855e-9a7a01b81ec1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.610224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1322/2623] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:24:16.614206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.624062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40103dd4-465a-4561-9eaa-9e54fbcffb76 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.629204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.630064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.630346 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.630626 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] PATH_INFO: `/v3/projects/8936cad5a6d846e0be2dcb616363d2ad/users/660d2935c44b47dd9cd41159d67a2791/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.645557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8936cad5a6d846e0be2dcb616363d2ad, user_id=660d2935c44b47dd9cd41159d67a2791, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.648241 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.663137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1302/2624] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:24:16 2022] PUT /identity/v3/projects/8936cad5a6d846e0be2dcb616363d2ad/users/660d2935c44b47dd9cd41159d67a2791/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:24:16.673413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446049b-6191-426a-8eaa-150e08625656 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.673830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446049b-6191-426a-8eaa-150e08625656 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.673984 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446049b-6191-426a-8eaa-150e08625656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.700874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a446049b-6191-426a-8eaa-150e08625656 None None] MFA Rules not processed for user `660d2935c44b47dd9cd41159d67a2791`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:16.702210 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a446049b-6191-426a-8eaa-150e08625656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:16.767564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1323/2625] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:16.779503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:24:16.781246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:16.838782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f9bd0-30d4-41c7-87ca-688633134cb6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:24:16.842505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109b4df-05f9-49e3-9010-94e71dddd98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:24:16.843146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109b4df-05f9-49e3-9010-94e71dddd98b service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:16.843433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109b4df-05f9-49e3-9010-94e71dddd98b service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:16.843715 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109b4df-05f9-49e3-9010-94e71dddd98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:16.852047 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109b4df-05f9-49e3-9010-94e71dddd98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:24:16.853580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109b4df-05f9-49e3-9010-94e71dddd98b service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:24:16.862917 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1303/2626] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:24:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:24:18.201705 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde949e4-fcf5-4427-907e-20149253665a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:24:18.202243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde949e4-fcf5-4427-907e-20149253665a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:24:18.202373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde949e4-fcf5-4427-907e-20149253665a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:24:18.219715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bde949e4-fcf5-4427-907e-20149253665a None None] MFA Rules not processed for user `660d2935c44b47dd9cd41159d67a2791`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:24:18.221776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bde949e4-fcf5-4427-907e-20149253665a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:24:18.228617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1324/2627] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:24:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:24:26.858343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:24:28.214477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=59,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:18.395934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8def525-5ccd-4fbb-b79f-7e4b04a523cd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:18.396463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8def525-5ccd-4fbb-b79f-7e4b04a523cd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:18.396584 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8def525-5ccd-4fbb-b79f-7e4b04a523cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:18.455261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c8def525-5ccd-4fbb-b79f-7e4b04a523cd None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:18.455441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde949e4-fcf5-4427-907e-20149253665a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:18.456520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c8def525-5ccd-4fbb-b79f-7e4b04a523cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:18.456730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bde949e4-fcf5-4427-907e-20149253665a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:18.532611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1304/2628] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:25:18.554110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde949e4-fcf5-4427-907e-20149253665a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:18.561186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:18.561872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:18.562184 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:18.562461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:18.564267 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:18.577295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:18.578900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:18.580714 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205201-e729-4ad5-bbc2-d6d3f6915052 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:18.581038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205201-e729-4ad5-bbc2-d6d3f6915052 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:18.581321 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205201-e729-4ad5-bbc2-d6d3f6915052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:18.589619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1325/2629] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:25:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:25:18.630459 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-98205201-e729-4ad5-bbc2-d6d3f6915052 None None] MFA Rules not processed for user `65e73243951044e4b5beb3de4ebb0a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:18.631680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-98205201-e729-4ad5-bbc2-d6d3f6915052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:18.708147 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1305/2630] 10.222.0.45 () {58 vars in 1040 bytes} [Thu Jul 21 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:25:18.714638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:18.725640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d99a-14e2-496a-af28-f2b2c43dcd73 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:18.731388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:18.732027 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:18.732317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:18.732602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:18.741343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:18.743763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:18.752318 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1326/2631] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 05:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:25:19.246646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dc937-f24d-4a1e-9729-a7516e6bb445 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:19.246959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dc937-f24d-4a1e-9729-a7516e6bb445 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:19.247246 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dc937-f24d-4a1e-9729-a7516e6bb445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:19.264959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dd9dc937-f24d-4a1e-9729-a7516e6bb445 None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:19.266170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd9dc937-f24d-4a1e-9729-a7516e6bb445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:19.273364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1306/2632] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jul 21 05:25:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:25:19.285871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:19.297065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f659f-5e1e-4a3b-adee-28b28c1fed28 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:19.302173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:19.302810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:19.303100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:19.303386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:19.311821 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:19.313510 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:19.322081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1327/2633] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 05:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 05:25:19.506807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7707-2f96-445f-b8ec-af62f5975a5c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:19.507295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7707-2f96-445f-b8ec-af62f5975a5c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:19.507395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7707-2f96-445f-b8ec-af62f5975a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:19.526056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-de4c7707-2f96-445f-b8ec-af62f5975a5c None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:19.527236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-de4c7707-2f96-445f-b8ec-af62f5975a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:19.534270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1307/2634] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 05:25:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:25:19.546110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:19.556304 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c330-87ef-478a-a045-b9ee01e900ce service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:19.561207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:19.561835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:19.562129 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:19.562621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:19.570688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:19.572770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:19.581070 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1328/2635] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 05:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:25:19.923398 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0f7f-9b69-4a1d-8536-42bc5bf551e2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:19.923686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0f7f-9b69-4a1d-8536-42bc5bf551e2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:19.923967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0f7f-9b69-4a1d-8536-42bc5bf551e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:19.936602 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:19.942581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ffae0f7f-9b69-4a1d-8536-42bc5bf551e2 None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:19.943789 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ffae0f7f-9b69-4a1d-8536-42bc5bf551e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:19.951632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1308/2636] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jul 21 05:25:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:25:19.963827 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:19.974041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647d878-6112-47ce-a8a8-53849aa2ddae service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:19.979219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984fb4-7cad-40a3-bebd-73be88630967 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:19.979848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984fb4-7cad-40a3-bebd-73be88630967 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:19.980134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984fb4-7cad-40a3-bebd-73be88630967 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:19.980415 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984fb4-7cad-40a3-bebd-73be88630967 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:19.988911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984fb4-7cad-40a3-bebd-73be88630967 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:19.990535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984fb4-7cad-40a3-bebd-73be88630967 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:19.999205 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1329/2637] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 05:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:25:22.036749 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0f7f-9b69-4a1d-8536-42bc5bf551e2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:22.097979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0f7f-9b69-4a1d-8536-42bc5bf551e2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:22.102434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:22.103291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.103570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.104442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] PATH_INFO: `/v3/users/660d2935c44b47dd9cd41159d67a2791` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.105593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] RBAC: Authorizing `identity:delete_user(user_id=660d2935c44b47dd9cd41159d67a2791)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:22.107502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:22.154942 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660d2935c44b47dd9cd41159d67a2791'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.167475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660d2935c44b47dd9cd41159d67a2791'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.168169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660d2935c44b47dd9cd41159d67a2791'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.175442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660d2935c44b47dd9cd41159d67a2791'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.183209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660d2935c44b47dd9cd41159d67a2791'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.189218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1309/2638] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:25:22 2022] DELETE /identity/v3/users/660d2935c44b47dd9cd41159d67a2791 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:25:22.193746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.194263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.194384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.211632 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:22.212880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:22.270435 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1330/2639] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:25:22.281604 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:22.283066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:22.340983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699a5c-b246-47af-86b7-d1da98fc490f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:22.344600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c1618-f4d6-43da-8b3e-3667c0e168ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:22.345268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c1618-f4d6-43da-8b3e-3667c0e168ab service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.345557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c1618-f4d6-43da-8b3e-3667c0e168ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.345840 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c1618-f4d6-43da-8b3e-3667c0e168ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.355422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c1618-f4d6-43da-8b3e-3667c0e168ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:22.356857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c1618-f4d6-43da-8b3e-3667c0e168ab service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:22.366195 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1310/2640] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:25:22.640697 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:22.642169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:22.655392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc562a-cc9a-4b3b-ad08-94451f9141d0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:22.661047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:22.661922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.662208 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.662485 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] PATH_INFO: `/v3/projects/8936cad5a6d846e0be2dcb616363d2ad` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.663683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8936cad5a6d846e0be2dcb616363d2ad)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:22.670204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:22.682791 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:22.718459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8936cad5a6d846e0be2dcb616363d2ad', 'request_id': 'req-a96921cd-e596-4818-b888-156adb3e9eac'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.725434 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8936cad5a6d846e0be2dcb616363d2ad', 'request_id': 'req-a96921cd-e596-4818-b888-156adb3e9eac'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.730834 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8936cad5a6d846e0be2dcb616363d2ad', 'request_id': 'req-a96921cd-e596-4818-b888-156adb3e9eac'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.742804 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] The token cache is being invalidate because project 8936cad5a6d846e0be2dcb616363d2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:25:22.743087 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.743720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a96921cd-e596-4818-b888-156adb3e9eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:22.745400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1331/2641] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:25:22 2022] DELETE /identity/v3/projects/8936cad5a6d846e0be2dcb616363d2ad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:25:22.750336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28b070-1f20-4dd9-8f43-aa823fb39b8d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.750634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28b070-1f20-4dd9-8f43-aa823fb39b8d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.750923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28b070-1f20-4dd9-8f43-aa823fb39b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.769164 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5b28b070-1f20-4dd9-8f43-aa823fb39b8d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:22.770372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5b28b070-1f20-4dd9-8f43-aa823fb39b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:22.787751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:22.830832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1311/2642] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:25:22.839805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200b2cf-5e93-4b6b-92d8-f1751df09c3f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.840099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200b2cf-5e93-4b6b-92d8-f1751df09c3f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.840385 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200b2cf-5e93-4b6b-92d8-f1751df09c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.858783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0200b2cf-5e93-4b6b-92d8-f1751df09c3f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:22.859981 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0200b2cf-5e93-4b6b-92d8-f1751df09c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:22.867735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1332/2643] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:25:22.871859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28b070-1f20-4dd9-8f43-aa823fb39b8d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:22.881326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28b070-1f20-4dd9-8f43-aa823fb39b8d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:22.886667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:22.887338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.887622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.887899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.888612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:22.888957 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:22.890546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:22.902839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1312/2644] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:22.906941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200b2cf-5e93-4b6b-92d8-f1751df09c3f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:22.916017 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200b2cf-5e93-4b6b-92d8-f1751df09c3f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:22.921214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:22.921855 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:22.922144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:22.922424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:22.923112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:22.925195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:22.952019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1333/2645] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:25:22 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:25:22.956218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:22.967138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a6c3-6754-4f61-a379-c66d2c3c3ed0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:23.021832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:23.022496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:23.022782 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:23.023063 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:23.024002 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:23.026578 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:23.049113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1313/2646] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:25:22 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:25:23.050284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:23.061231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c34d64-54ff-49cb-910d-7053ea03cd54 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:23.065861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:23.066520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:23.066810 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:23.067091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:23.067811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:23.069450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:23.080453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1334/2647] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:25:23.084501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:23.095639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e09a9c-e6ab-4b7b-8078-b1e65b36f06e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:23.100309 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649bda0-9bda-4e99-8027-2df24eb8999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:23.101005 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bda0-9bda-4e99-8027-2df24eb8999f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:23.101324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bda0-9bda-4e99-8027-2df24eb8999f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:23.101605 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bda0-9bda-4e99-8027-2df24eb8999f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:23.102325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649bda0-9bda-4e99-8027-2df24eb8999f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:23.103953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649bda0-9bda-4e99-8027-2df24eb8999f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:23.113802 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1314/2648] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:25:23.117859 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:23.128663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcc005-aa36-4f1c-a3d9-0c837fb47289 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:23.133521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:23.134406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:23.134691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:23.135525 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] PATH_INFO: `/v3/projects/2b795ed5b8094854b75a5ee40fdb1327/users/eca750aec1584774a202c8693dfc14dc/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:23.150494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b795ed5b8094854b75a5ee40fdb1327, user_id=eca750aec1584774a202c8693dfc14dc, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:23.153441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:23.166193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1335/2649] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:25:23 2022] PUT /identity/v3/projects/2b795ed5b8094854b75a5ee40fdb1327/users/eca750aec1584774a202c8693dfc14dc/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:25:23.177125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d328-e262-4e37-90b5-5062567e8334 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:23.177419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d328-e262-4e37-90b5-5062567e8334 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:23.177703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d328-e262-4e37-90b5-5062567e8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:23.206286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6972d328-e262-4e37-90b5-5062567e8334 None None] MFA Rules not processed for user `eca750aec1584774a202c8693dfc14dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:23.207499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6972d328-e262-4e37-90b5-5062567e8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:23.271078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1315/2650] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:25:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:25:23.282651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:23.284380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:23.342395 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fdd4a-723f-4609-b68b-88f3b2eb865a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:23.346133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afce1ea-4e0a-491c-ac79-7ddd15d235f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:23.346775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afce1ea-4e0a-491c-ac79-7ddd15d235f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:23.347063 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afce1ea-4e0a-491c-ac79-7ddd15d235f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:23.347348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afce1ea-4e0a-491c-ac79-7ddd15d235f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:23.355931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afce1ea-4e0a-491c-ac79-7ddd15d235f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:23.357404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afce1ea-4e0a-491c-ac79-7ddd15d235f8 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:23.366153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1336/2651] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:25:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:25:30.366071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d328-e262-4e37-90b5-5062567e8334 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:30.385288 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:30.429363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d328-e262-4e37-90b5-5062567e8334 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:30.434384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:30.435279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:30.435562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:30.435837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] PATH_INFO: `/v3/users/eca750aec1584774a202c8693dfc14dc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:30.437039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca750aec1584774a202c8693dfc14dc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:30.438967 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:30.483852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca750aec1584774a202c8693dfc14dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:30.496125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca750aec1584774a202c8693dfc14dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:30.496806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca750aec1584774a202c8693dfc14dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:30.503837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca750aec1584774a202c8693dfc14dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:30.511037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca750aec1584774a202c8693dfc14dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:30.516943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1316/2652] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:25:30 2022] DELETE /identity/v3/users/eca750aec1584774a202c8693dfc14dc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:25:30.521543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:30.522028 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:30.522150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:30.539677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:30.540995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:30.574417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:30.601915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1337/2653] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:25:30.612366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:30.613773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:30.671292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f04dc9-f81d-4d4d-b2c2-ec63782782a0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:30.675108 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:30.675750 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:30.676033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:30.676308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:30.685583 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:30.687016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:30.696284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1317/2654] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:25:30.960745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:30.962321 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:30.976180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d62a-1c13-41b9-a9de-6c04185707cd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:30.981534 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:30.982840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:30.982840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:30.983051 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] PATH_INFO: `/v3/projects/2b795ed5b8094854b75a5ee40fdb1327` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:30.984148 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b795ed5b8094854b75a5ee40fdb1327)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:30.986068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:31.035060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b795ed5b8094854b75a5ee40fdb1327', 'request_id': 'req-15f3516e-9fe1-4c98-802f-52ec4232a2b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:31.042384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b795ed5b8094854b75a5ee40fdb1327', 'request_id': 'req-15f3516e-9fe1-4c98-802f-52ec4232a2b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:31.047830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b795ed5b8094854b75a5ee40fdb1327', 'request_id': 'req-15f3516e-9fe1-4c98-802f-52ec4232a2b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:31.058638 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] The token cache is being invalidate because project 2b795ed5b8094854b75a5ee40fdb1327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:25:31.058922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:31.059563 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:25:31.061124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1338/2655] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:25:30 2022] DELETE /identity/v3/projects/2b795ed5b8094854b75a5ee40fdb1327 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:25:40.692127 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:41.055628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.170366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.172468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:08.197403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dae494-0173-4b24-972b-b915d4df83de service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.244727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7665e3-0b98-4ecd-aa5b-0edabf1025d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.245324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7665e3-0b98-4ecd-aa5b-0edabf1025d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.245612 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7665e3-0b98-4ecd-aa5b-0edabf1025d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.245896 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7665e3-0b98-4ecd-aa5b-0edabf1025d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.247687 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8d7665e3-0b98-4ecd-aa5b-0edabf1025d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:08.257464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7665e3-0b98-4ecd-aa5b-0edabf1025d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.258906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7665e3-0b98-4ecd-aa5b-0edabf1025d8 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.266697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1318/2656] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:27:18.263273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=31 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:22.474529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:22.475926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:22.577308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3516e-9fe1-4c98-802f-52ec4232a2b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:22.582940 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:22.583581 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:22.583867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:22.584145 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:22.585895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:22.596985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:22.598546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:22.608251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1339/2657] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:30:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:30:32.604053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=48 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:03.795129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ec704-a5ee-4e1e-ac76-1c53a919b9a1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:03.795702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ec704-a5ee-4e1e-ac76-1c53a919b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:03.795702 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ec704-a5ee-4e1e-ac76-1c53a919b9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:03.814021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-575ec704-a5ee-4e1e-ac76-1c53a919b9a1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:03.815230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-575ec704-a5ee-4e1e-ac76-1c53a919b9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:03.875391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1319/2658] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:03.884922 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:03.886320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:03.897551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b7bd-9a64-4ce1-a679-aa4ae3ec3ad4 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:03.901374 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167425d-5d33-4893-9651-ed775e2cb8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:03.902005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167425d-5d33-4893-9651-ed775e2cb8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:03.902293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167425d-5d33-4893-9651-ed775e2cb8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:03.902574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167425d-5d33-4893-9651-ed775e2cb8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:03.911441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167425d-5d33-4893-9651-ed775e2cb8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:03.912894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167425d-5d33-4893-9651-ed775e2cb8a2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:03.922895 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1340/2659] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:06.364003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b0a-1769-4ad0-92ca-fc233daf36cc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.364542 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b0a-1769-4ad0-92ca-fc233daf36cc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.364647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b0a-1769-4ad0-92ca-fc233daf36cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.394253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-02a39b0a-1769-4ad0-92ca-fc233daf36cc None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:06.395440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-02a39b0a-1769-4ad0-92ca-fc233daf36cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:06.403510 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1320/2660] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:06.411463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69655aea-3da2-425f-96fb-46492680478b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.411950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69655aea-3da2-425f-96fb-46492680478b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.412066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69655aea-3da2-425f-96fb-46492680478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.429956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-69655aea-3da2-425f-96fb-46492680478b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:06.431155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69655aea-3da2-425f-96fb-46492680478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:06.439512 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1341/2661] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:06.443737 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a39b0a-1769-4ad0-92ca-fc233daf36cc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:06.453587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a39b0a-1769-4ad0-92ca-fc233daf36cc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:06.458210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:06.458865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.459146 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.459422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.460135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:31:06.460440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:06.462074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:06.474308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1321/2662] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:31:06.478518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69655aea-3da2-425f-96fb-46492680478b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:06.488219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69655aea-3da2-425f-96fb-46492680478b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:06.492746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:06.493416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.493706 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.493989 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.494675 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:06.496624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:06.521954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1342/2663] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:31:06 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:31:06.526354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:06.537198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528846d-2db2-4f15-9001-030e562fbb71 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:06.591961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:06.592562 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.592869 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.593751 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.594326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:06.596247 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:06.617977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1322/2664] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:31:06 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:31:06.622049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:06.634053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc13e04-59f6-40f9-b3f1-cba8cf586e61 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:06.638730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:06.639389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.639676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.640026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.640713 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:06.642455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:06.664365 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1343/2665] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:31:06.665477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:06.677263 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bd53f-b13e-4179-82ca-896fd7d0e354 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:06.682038 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5acb-a984-47d1-9165-0338f30e6e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:06.682701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5acb-a984-47d1-9165-0338f30e6e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.682989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5acb-a984-47d1-9165-0338f30e6e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.683269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5acb-a984-47d1-9165-0338f30e6e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.683991 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5acb-a984-47d1-9165-0338f30e6e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:06.685648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5acb-a984-47d1-9165-0338f30e6e25 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:06.699412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1323/2666] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:31:06.700592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:06.710749 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567004-ce81-4529-8524-e365616e20f7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:06.715444 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:06.716324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.716608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.716925 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] PATH_INFO: `/v3/projects/ffe140cc17954d418c9ed2b639e36938/users/2927a2c5af9a4dc288bab1d7ee290bf1/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.732163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe140cc17954d418c9ed2b639e36938, user_id=2927a2c5af9a4dc288bab1d7ee290bf1, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:06.736036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:06.749313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1344/2667] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:31:06 2022] PUT /identity/v3/projects/ffe140cc17954d418c9ed2b639e36938/users/2927a2c5af9a4dc288bab1d7ee290bf1/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:31:06.759985 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8f4bf-b65f-4acd-bce4-e1536cd798f0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:06.760282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8f4bf-b65f-4acd-bce4-e1536cd798f0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:06.760570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8f4bf-b65f-4acd-bce4-e1536cd798f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:06.789411 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2db8f4bf-b65f-4acd-bce4-e1536cd798f0 None None] MFA Rules not processed for user `2927a2c5af9a4dc288bab1d7ee290bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:06.790677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2db8f4bf-b65f-4acd-bce4-e1536cd798f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:06.831913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:06.857105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1324/2668] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:31:16.745354 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:16.854174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=9 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:06.932075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:06.999384 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1400bfb-3a23-4756-bd0f-69c327580d90 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:07.004375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:07.005294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.005585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.005872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] PATH_INFO: `/v3/users/2927a2c5af9a4dc288bab1d7ee290bf1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.007091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2927a2c5af9a4dc288bab1d7ee290bf1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:07.009098 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:07.058767 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2927a2c5af9a4dc288bab1d7ee290bf1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.070441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2927a2c5af9a4dc288bab1d7ee290bf1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.078134 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2927a2c5af9a4dc288bab1d7ee290bf1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.085110 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2927a2c5af9a4dc288bab1d7ee290bf1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.085732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2927a2c5af9a4dc288bab1d7ee290bf1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.091618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1345/2669] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:32:06 2022] DELETE /identity/v3/users/2927a2c5af9a4dc288bab1d7ee290bf1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:07.096629 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.097179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.097322 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.115224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:07.116448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:07.174566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1325/2670] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:07.184380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:07.185951 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:07.252625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb67b3c-b323-47a7-8236-9485b3a524f6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:07.256271 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d4f89-3339-4fa3-9018-cc6616010169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:07.256958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4f89-3339-4fa3-9018-cc6616010169 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.257252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4f89-3339-4fa3-9018-cc6616010169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.257538 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d4f89-3339-4fa3-9018-cc6616010169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.267207 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d4f89-3339-4fa3-9018-cc6616010169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:07.268642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d4f89-3339-4fa3-9018-cc6616010169 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:07.278336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1346/2671] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:07.549074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:07.550500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:07.563768 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f1c16-7f35-4ee0-9652-357ba6f723a8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:07.568624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:07.569520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.569814 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.570099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] PATH_INFO: `/v3/projects/ffe140cc17954d418c9ed2b639e36938` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.571379 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe140cc17954d418c9ed2b639e36938)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:07.574272 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:07.623566 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe140cc17954d418c9ed2b639e36938', 'request_id': 'req-1ec8214f-850f-4c58-a672-7b57b1b7106c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.629792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe140cc17954d418c9ed2b639e36938', 'request_id': 'req-1ec8214f-850f-4c58-a672-7b57b1b7106c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.637105 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe140cc17954d418c9ed2b639e36938', 'request_id': 'req-1ec8214f-850f-4c58-a672-7b57b1b7106c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.647663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] The token cache is being invalidate because project ffe140cc17954d418c9ed2b639e36938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:32:07.647955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.648582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ec8214f-850f-4c58-a672-7b57b1b7106c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:07.650401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1326/2672] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:32:07 2022] DELETE /identity/v3/projects/ffe140cc17954d418c9ed2b639e36938 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:07.655462 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92095-ce7e-4ebc-97b1-2bfb45a160f6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.655816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92095-ce7e-4ebc-97b1-2bfb45a160f6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.656112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92095-ce7e-4ebc-97b1-2bfb45a160f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.674292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b4c92095-ce7e-4ebc-97b1-2bfb45a160f6 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:07.675520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4c92095-ce7e-4ebc-97b1-2bfb45a160f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:07.684022 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:07.738241 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1347/2673] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:07.747256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18b2c0-4db9-40b1-9493-4e741aee6be8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.747552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18b2c0-4db9-40b1-9493-4e741aee6be8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.748454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18b2c0-4db9-40b1-9493-4e741aee6be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.768044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5e18b2c0-4db9-40b1-9493-4e741aee6be8 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:07.769662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5e18b2c0-4db9-40b1-9493-4e741aee6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:07.779123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1327/2674] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:07.783437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c92095-ce7e-4ebc-97b1-2bfb45a160f6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:07.795621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c92095-ce7e-4ebc-97b1-2bfb45a160f6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:07.800924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:07.802394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.802693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.802978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.803709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:32:07.804020 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:07.805753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:07.820404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1348/2675] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:32:07.824693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18b2c0-4db9-40b1-9493-4e741aee6be8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:07.835014 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18b2c0-4db9-40b1-9493-4e741aee6be8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:07.845389 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:07.846357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.846858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.847366 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.848069 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:07.850021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:07.880132 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1328/2676] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:32:07 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:07.884011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:07.894676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2598d4-996e-4e2a-ba53-7fddebb55cea admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:07.955872 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:07.956577 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.956838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.957130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.957820 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:07.959734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:07.980628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1349/2677] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:32:07 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:32:07.986238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:07.996340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d7f0-4648-43a4-b2a9-e9a809b9ff69 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.001234 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.001889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.002279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.002561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.003285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.004911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.015968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1329/2678] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:32:08.020126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.031293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1ba4c-5696-4843-b4cb-7728ac183867 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.035968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2038634-f57a-4871-bb5e-ffcace81e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.036625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2038634-f57a-4871-bb5e-ffcace81e901 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.036955 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2038634-f57a-4871-bb5e-ffcace81e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.037242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2038634-f57a-4871-bb5e-ffcace81e901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.037968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2038634-f57a-4871-bb5e-ffcace81e901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.039564 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2038634-f57a-4871-bb5e-ffcace81e901 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.050172 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1350/2679] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:08.054453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.064408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43c17-2976-4c73-819e-4097f7406c14 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.068963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.069830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.070112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.070388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] PATH_INFO: `/v3/projects/4d1ee82cd463433d9a88feb75e22d2b7/users/1384bc912ff349a099e4038919acf30f/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.084979 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1ee82cd463433d9a88feb75e22d2b7, user_id=1384bc912ff349a099e4038919acf30f, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.087697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.100913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1330/2680] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:08 2022] PUT /identity/v3/projects/4d1ee82cd463433d9a88feb75e22d2b7/users/1384bc912ff349a099e4038919acf30f/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:08.158904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91f4d-fc8d-4217-b762-6ef8c6052a7a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.159202 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91f4d-fc8d-4217-b762-6ef8c6052a7a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.159524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91f4d-fc8d-4217-b762-6ef8c6052a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.186494 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-48d91f4d-fc8d-4217-b762-6ef8c6052a7a None None] MFA Rules not processed for user `1384bc912ff349a099e4038919acf30f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:08.187733 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-48d91f4d-fc8d-4217-b762-6ef8c6052a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:08.251663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1351/2681] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:08.256167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.277297 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:08.320354 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df15a-17b0-4b6e-b471-5ddecb60882a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.325137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.326318 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.326641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.326928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.327628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.329591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.354807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1331/2682] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:32:08 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:08.359019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91f4d-fc8d-4217-b762-6ef8c6052a7a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.369648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91f4d-fc8d-4217-b762-6ef8c6052a7a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.374282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:08.427171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.427838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.428132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.428421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.429147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.431066 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.450356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1352/2683] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:32:08 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:08.454844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.465003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450464c-7340-4a8d-bc2e-3a5ce430f411 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.470308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.470954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.471240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.471518 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.472237 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.473861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.485198 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1332/2684] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:08.489189 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.498977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83f2fb-4515-4f35-84eb-c55dfd99f360 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.503704 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.504532 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.504841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.505136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] PATH_INFO: `/v3/projects/098d2f53e7ad41fca627471e46174a57/users/821ccb10fc9246778d1349585d867c50/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.520351 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098d2f53e7ad41fca627471e46174a57, user_id=821ccb10fc9246778d1349585d867c50, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.523059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.536133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1353/2685] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:08 2022] PUT /identity/v3/projects/098d2f53e7ad41fca627471e46174a57/users/821ccb10fc9246778d1349585d867c50/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:08.539920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.549863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab2ef-8d3f-4ab1-b215-7b6c9c096e9c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.603858 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f5a4-5e43-406d-988b-b4cdaa68d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.604505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f5a4-5e43-406d-988b-b4cdaa68d96d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.604794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f5a4-5e43-406d-988b-b4cdaa68d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.605101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f5a4-5e43-406d-988b-b4cdaa68d96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.605812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70f5a4-5e43-406d-988b-b4cdaa68d96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.607470 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70f5a4-5e43-406d-988b-b4cdaa68d96d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.617048 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1333/2686] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:08.621112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.631689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d987cd-c9a2-4b04-944a-87bedcc8d612 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.636219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.637113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.637396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.637671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] PATH_INFO: `/v3/projects/098d2f53e7ad41fca627471e46174a57/users/821ccb10fc9246778d1349585d867c50/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.640474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=098d2f53e7ad41fca627471e46174a57, user_id=821ccb10fc9246778d1349585d867c50, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.643133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.653422 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1354/2687] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:08 2022] PUT /identity/v3/projects/098d2f53e7ad41fca627471e46174a57/users/821ccb10fc9246778d1349585d867c50/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:32:08.664078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768270-ea2a-480b-ac69-d7d0ac55684e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.664369 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768270-ea2a-480b-ac69-d7d0ac55684e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.664650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768270-ea2a-480b-ac69-d7d0ac55684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.691233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-df768270-ea2a-480b-ac69-d7d0ac55684e None None] MFA Rules not processed for user `821ccb10fc9246778d1349585d867c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:08.692440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-df768270-ea2a-480b-ac69-d7d0ac55684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:08.761185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1334/2688] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:08.774428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.776127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:08.834629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2c864-28f2-4800-98ba-7a3ae6f186fa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.838585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.839224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.839519 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.839944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.849576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.851008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.860517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1355/2689] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:32:08.932333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df768270-ea2a-480b-ac69-d7d0ac55684e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.942543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df768270-ea2a-480b-ac69-d7d0ac55684e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.946235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.946876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.947165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.947448 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.960227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:09.005008 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:09.006457 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:09.016109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1335/2690] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:14.624648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:14.626157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:14.684311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bbe9f-0ffd-43f9-9adc-523524a37856 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:14.687900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a4e03-7bc9-41c6-bcbb-29048f1c8b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:14.688549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a4e03-7bc9-41c6-bcbb-29048f1c8b1a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:14.688869 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a4e03-7bc9-41c6-bcbb-29048f1c8b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:14.689156 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a4e03-7bc9-41c6-bcbb-29048f1c8b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:14.690924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-932a4e03-7bc9-41c6-bcbb-29048f1c8b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:14.700055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a4e03-7bc9-41c6-bcbb-29048f1c8b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:14.702011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a4e03-7bc9-41c6-bcbb-29048f1c8b1a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:14.709840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1356/2691] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:17.798438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:17.861215 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f58bc0-d64b-4d29-84df-9ac5eefb0e9f service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:17.865877 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:17.866744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:17.867034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:17.867315 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] PATH_INFO: `/v3/users/1384bc912ff349a099e4038919acf30f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:17.868503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1384bc912ff349a099e4038919acf30f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:17.870479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:17.916200 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1384bc912ff349a099e4038919acf30f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:17.929118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1384bc912ff349a099e4038919acf30f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:17.929790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1384bc912ff349a099e4038919acf30f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:17.937022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1384bc912ff349a099e4038919acf30f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:17.943868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1384bc912ff349a099e4038919acf30f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:17.949741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1336/2692] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:32:17 2022] DELETE /identity/v3/users/1384bc912ff349a099e4038919acf30f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:17.954428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:17.954923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:17.955042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:17.967328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:17.973513 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:17.974714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:18.032867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1357/2693] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:18.042250 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:18.043697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:18.079447 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:18.103551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db781d70-eb0d-4e25-9b2b-c7edd5a2071a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:18.107438 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:18.108080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:18.108367 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:18.108651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:18.117824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:18.119262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:18.129777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1337/2694] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:18.397776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:18.399468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:18.412195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712b0f1-21be-4655-83d7-9b8f57bbcf58 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:18.416812 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:18.417702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:18.417988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:18.418268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] PATH_INFO: `/v3/projects/4d1ee82cd463433d9a88feb75e22d2b7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:18.419995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1ee82cd463433d9a88feb75e22d2b7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:18.422136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:18.470263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1ee82cd463433d9a88feb75e22d2b7', 'request_id': 'req-83117b03-a04c-4e41-b572-c482ca655613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.477158 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1ee82cd463433d9a88feb75e22d2b7', 'request_id': 'req-83117b03-a04c-4e41-b572-c482ca655613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.483541 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1ee82cd463433d9a88feb75e22d2b7', 'request_id': 'req-83117b03-a04c-4e41-b572-c482ca655613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.497233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] The token cache is being invalidate because project 4d1ee82cd463433d9a88feb75e22d2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:32:18.497549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.498191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.499734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1358/2695] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:32:18 2022] DELETE /identity/v3/projects/4d1ee82cd463433d9a88feb75e22d2b7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:18.503830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:18.513494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b0f87-53b3-4a77-93bc-26d1fe6385fe service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:18.570409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:18.571284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:18.571571 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:18.571852 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] PATH_INFO: `/v3/users/821ccb10fc9246778d1349585d867c50` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:18.573079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821ccb10fc9246778d1349585d867c50)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:18.575015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:18.620279 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821ccb10fc9246778d1349585d867c50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.632384 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821ccb10fc9246778d1349585d867c50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.633082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821ccb10fc9246778d1349585d867c50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.640426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821ccb10fc9246778d1349585d867c50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.647348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0efd842f-800c-4e59-8a69-aee804d16208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821ccb10fc9246778d1349585d867c50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:18.654150 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1338/2696] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:32:18 2022] DELETE /identity/v3/users/821ccb10fc9246778d1349585d867c50 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:18.922956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:18.925108 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:18.938390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117b03-a04c-4e41-b572-c482ca655613 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:18.995026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:18.995894 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:18.996180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:18.996514 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] PATH_INFO: `/v3/projects/098d2f53e7ad41fca627471e46174a57` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:18.997712 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098d2f53e7ad41fca627471e46174a57)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:18.999646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.034880 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:19.048663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098d2f53e7ad41fca627471e46174a57', 'request_id': 'req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:19.055640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098d2f53e7ad41fca627471e46174a57', 'request_id': 'req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:19.061465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098d2f53e7ad41fca627471e46174a57', 'request_id': 'req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:19.072428 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] The token cache is being invalidate because project 098d2f53e7ad41fca627471e46174a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:32:19.072715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:19.073375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a850bbb9-e6ca-44f9-99dd-6958d4ca38c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:19.074905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1359/2697] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:32:18 2022] DELETE /identity/v3/projects/098d2f53e7ad41fca627471e46174a57 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:19.080433 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428737fb-3d52-42ba-9e74-3500706a398f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.080937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428737fb-3d52-42ba-9e74-3500706a398f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.081167 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428737fb-3d52-42ba-9e74-3500706a398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.099908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-428737fb-3d52-42ba-9e74-3500706a398f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:19.101242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-428737fb-3d52-42ba-9e74-3500706a398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:19.148161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:19.162295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1339/2698] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:19.171630 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0b8ff-e9ab-4701-af50-99d2afa30fa2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.171924 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0b8ff-e9ab-4701-af50-99d2afa30fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.172209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0b8ff-e9ab-4701-af50-99d2afa30fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.191089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-70c0b8ff-e9ab-4701-af50-99d2afa30fa2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:19.192291 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-70c0b8ff-e9ab-4701-af50-99d2afa30fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:19.200171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1360/2699] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:19.205079 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428737fb-3d52-42ba-9e74-3500706a398f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:19.215004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428737fb-3d52-42ba-9e74-3500706a398f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:19.220273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:19.220963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.221256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.221540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.222268 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:32:19.222580 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:19.224187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.236041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1340/2700] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:32:19.240324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0b8ff-e9ab-4701-af50-99d2afa30fa2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:19.250040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0b8ff-e9ab-4701-af50-99d2afa30fa2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:19.256440 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:19.257116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.257402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.257681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.258369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:19.260264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.286198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1361/2701] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:32:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:32:19.290274 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:19.300097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3638f92-ab20-4460-b071-8cdeacaab51a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:19.359265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:19.359946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.360230 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.360505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.361229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:19.363196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.384363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1341/2702] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:32:19 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:19.389621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:19.399882 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3653cf-5839-4ef4-b899-4bd97d496a24 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:19.407819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:19.408486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.408773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.409081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.409802 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:19.411393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.422420 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1362/2703] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:19.426454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:19.437202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbfd9b-a75f-4340-9f8d-006b9d046462 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:19.441900 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1760139-0559-4644-b6ec-dfdf9bbadf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:19.442557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760139-0559-4644-b6ec-dfdf9bbadf15 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.442843 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760139-0559-4644-b6ec-dfdf9bbadf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.443124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760139-0559-4644-b6ec-dfdf9bbadf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.443848 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1760139-0559-4644-b6ec-dfdf9bbadf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:19.445496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1760139-0559-4644-b6ec-dfdf9bbadf15 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.456088 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1342/2704] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:19.460093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:19.470671 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9f0f1-5721-4152-989e-fb0af04372cc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:19.475260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:19.476122 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.476404 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.476680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] PATH_INFO: `/v3/projects/130b9273b4684031bd490c4456879bf7/users/d083af82f9b24ee598db986b0d1ab60e/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.491362 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130b9273b4684031bd490c4456879bf7, user_id=d083af82f9b24ee598db986b0d1ab60e, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:19.494032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.507734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1363/2705] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:19 2022] PUT /identity/v3/projects/130b9273b4684031bd490c4456879bf7/users/d083af82f9b24ee598db986b0d1ab60e/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:32:19.518883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8f223-cd14-4571-949e-00b8dac4bf18 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.519179 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8f223-cd14-4571-949e-00b8dac4bf18 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.519469 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8f223-cd14-4571-949e-00b8dac4bf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.545440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a0c8f223-cd14-4571-949e-00b8dac4bf18 None None] MFA Rules not processed for user `d083af82f9b24ee598db986b0d1ab60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:19.546658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a0c8f223-cd14-4571-949e-00b8dac4bf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:19.611153 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1343/2706] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:19.622224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:19.624461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:19.681239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b4da-d54c-4509-a683-2f810338dff0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:19.685427 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d94c-715e-4b40-bbb4-ca5b50ef3998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:19.686076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d94c-715e-4b40-bbb4-ca5b50ef3998 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:19.686361 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d94c-715e-4b40-bbb4-ca5b50ef3998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:19.686640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d94c-715e-4b40-bbb4-ca5b50ef3998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:19.695159 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d94c-715e-4b40-bbb4-ca5b50ef3998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:19.696585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d94c-715e-4b40-bbb4-ca5b50ef3998 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:19.705432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1364/2707] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:29.607741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:29.701369 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:38.359502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8f223-cd14-4571-949e-00b8dac4bf18 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:38.439441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8f223-cd14-4571-949e-00b8dac4bf18 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:38.443892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:38.444755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:38.445071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:38.445355 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] PATH_INFO: `/v3/users/d083af82f9b24ee598db986b0d1ab60e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:38.446545 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d083af82f9b24ee598db986b0d1ab60e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:38.448479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:38.493904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd083af82f9b24ee598db986b0d1ab60e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:38.506209 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd083af82f9b24ee598db986b0d1ab60e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:38.506883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd083af82f9b24ee598db986b0d1ab60e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:38.514401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd083af82f9b24ee598db986b0d1ab60e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:38.521440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd083af82f9b24ee598db986b0d1ab60e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:38.527554 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1344/2708] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:32:38 2022] DELETE /identity/v3/users/d083af82f9b24ee598db986b0d1ab60e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:38.532717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:38.533249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:38.533373 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:38.570794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:38.572018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:38.630681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1365/2709] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:38.641302 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:38.642726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:38.700301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884708e-0a8d-40a9-930b-727ae02b013b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:38.704593 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fc017-c795-4868-b201-fd4c3e2296a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:38.705266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fc017-c795-4868-b201-fd4c3e2296a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:38.705555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fc017-c795-4868-b201-fd4c3e2296a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:38.705837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fc017-c795-4868-b201-fd4c3e2296a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:38.714819 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fc017-c795-4868-b201-fd4c3e2296a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:38.716311 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fc017-c795-4868-b201-fd4c3e2296a7 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:38.725711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1345/2710] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:38.994214 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:38.995654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:39.008687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c01acf-6cb1-4de6-840f-8e142ef39146 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.014201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.015144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.015527 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.015881 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] PATH_INFO: `/v3/projects/130b9273b4684031bd490c4456879bf7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.017225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130b9273b4684031bd490c4456879bf7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.019224 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.067622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130b9273b4684031bd490c4456879bf7', 'request_id': 'req-d58e64ba-b009-487f-a89c-289101f68f37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:39.074831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130b9273b4684031bd490c4456879bf7', 'request_id': 'req-d58e64ba-b009-487f-a89c-289101f68f37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:39.080687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130b9273b4684031bd490c4456879bf7', 'request_id': 'req-d58e64ba-b009-487f-a89c-289101f68f37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:39.092081 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] The token cache is being invalidate because project 130b9273b4684031bd490c4456879bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:32:39.092377 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:39.093056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d58e64ba-b009-487f-a89c-289101f68f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:39.094623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1366/2711] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:32:38 2022] DELETE /identity/v3/projects/130b9273b4684031bd490c4456879bf7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:39.099467 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51501287-1d72-4c51-bd92-15744dca1ac0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.099786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51501287-1d72-4c51-bd92-15744dca1ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.100067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51501287-1d72-4c51-bd92-15744dca1ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.105078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:39.139731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-51501287-1d72-4c51-bd92-15744dca1ac0 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:39.140983 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51501287-1d72-4c51-bd92-15744dca1ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:39.202535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1346/2712] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:39.211163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d78e-4080-4a4c-b9d7-45135dd9964b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.211461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d78e-4080-4a4c-b9d7-45135dd9964b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.211751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d78e-4080-4a4c-b9d7-45135dd9964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.230002 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d9d1d78e-4080-4a4c-b9d7-45135dd9964b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:39.231209 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d9d1d78e-4080-4a4c-b9d7-45135dd9964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:39.239905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1367/2713] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:39.244111 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51501287-1d72-4c51-bd92-15744dca1ac0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.254416 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51501287-1d72-4c51-bd92-15744dca1ac0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.259046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.259884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.260181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.260460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.261261 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:32:39.261572 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.263192 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.274960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1347/2714] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:32:39.279302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1d78e-4080-4a4c-b9d7-45135dd9964b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.288562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1d78e-4080-4a4c-b9d7-45135dd9964b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.293248 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.293900 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.294183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.294980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.295678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.297623 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.332983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1368/2715] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:39.337056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.347568 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727aeb-b9d4-4dbb-a73c-98c3d743d36a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.408844 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.409870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.409870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.410239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.410746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.412652 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.432397 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1348/2716] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:32:39.437491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.447799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41185e65-1f3b-4979-b864-7447d8ce5d53 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.452710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.453410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.453734 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.454016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.454744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.456352 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.467038 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1369/2717] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:39.471406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.481500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f6a2c-c88f-4ddf-9233-974d7032c93f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.486920 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb8451-0f45-4a9a-acbe-7fb2ea453cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.487567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8451-0f45-4a9a-acbe-7fb2ea453cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.487850 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8451-0f45-4a9a-acbe-7fb2ea453cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.488154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8451-0f45-4a9a-acbe-7fb2ea453cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.488916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8451-0f45-4a9a-acbe-7fb2ea453cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.490559 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8451-0f45-4a9a-acbe-7fb2ea453cd9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.500352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1349/2718] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:39.504430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.514947 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861f356-16ef-47be-93cf-8e59f5531503 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.519448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.520308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.520589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.520893 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] PATH_INFO: `/v3/projects/c643c82bdb4e4ab4804bf753c59b3c7b/users/61946667877447e0bdf6514583a56f43/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.536565 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c643c82bdb4e4ab4804bf753c59b3c7b, user_id=61946667877447e0bdf6514583a56f43, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.539243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.541441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:39.555482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1370/2719] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:39 2022] PUT /identity/v3/projects/c643c82bdb4e4ab4804bf753c59b3c7b/users/61946667877447e0bdf6514583a56f43/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:32:39.566139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b89101-4777-43f1-880d-00925e6c795d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.566432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b89101-4777-43f1-880d-00925e6c795d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.566717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b89101-4777-43f1-880d-00925e6c795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.593004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b3b89101-4777-43f1-880d-00925e6c795d None None] MFA Rules not processed for user `61946667877447e0bdf6514583a56f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:39.594201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b3b89101-4777-43f1-880d-00925e6c795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:39.641929 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:39.664269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1350/2720] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:39.668939 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.730150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c2d40-19db-43c5-b719-21bdf357894d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.735576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.736255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.736540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.736833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.737529 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.739459 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.764039 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1371/2721] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:39.768032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b89101-4777-43f1-880d-00925e6c795d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.780163 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b89101-4777-43f1-880d-00925e6c795d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.835721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.836386 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.836692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.837033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.837707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.839617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.858731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1351/2722] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:39.862684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.872916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a1c8-9538-46ef-87bf-0a0a992442be admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.877799 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.878463 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.878753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.879034 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.879761 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.881455 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.892537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1372/2723] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:39.896220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.906902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2ee8-837f-4992-b2a5-120600598a0c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.911535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a51b11-91cb-4215-b5d3-077bb4a65df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.912180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51b11-91cb-4215-b5d3-077bb4a65df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.912468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51b11-91cb-4215-b5d3-077bb4a65df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.912745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51b11-91cb-4215-b5d3-077bb4a65df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.913497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a51b11-91cb-4215-b5d3-077bb4a65df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.915081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a51b11-91cb-4215-b5d3-077bb4a65df3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.925726 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1352/2724] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:39.929659 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:39.939599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4484-b232-4d1d-b2bb-b72e55fe0a4b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:39.944191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:39.945104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.945394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.945677 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] PATH_INFO: `/v3/projects/c6254694673a44c2ba268879054d424f/users/8d27c960c92a411e875a074157de8557/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.961983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6254694673a44c2ba268879054d424f, user_id=8d27c960c92a411e875a074157de8557, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:39.964622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:39.978139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1373/2725] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:39 2022] PUT /identity/v3/projects/c6254694673a44c2ba268879054d424f/users/8d27c960c92a411e875a074157de8557/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:39.989347 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8dfa-8824-42f8-8c87-fe842f01bc80 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.989642 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8dfa-8824-42f8-8c87-fe842f01bc80 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.989924 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8dfa-8824-42f8-8c87-fe842f01bc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.017746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-edbd8dfa-8824-42f8-8c87-fe842f01bc80 None None] MFA Rules not processed for user `8d27c960c92a411e875a074157de8557`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:40.018891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-edbd8dfa-8824-42f8-8c87-fe842f01bc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:40.083026 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1353/2726] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:40.087569 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.148576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7028f-ed2b-4940-995c-73552dbf0fe3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.153719 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.155025 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.155343 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.155619 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.156338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.158348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.184135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1374/2727] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:40.189037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd8dfa-8824-42f8-8c87-fe842f01bc80 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.199810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd8dfa-8824-42f8-8c87-fe842f01bc80 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.247089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:40.257020 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.257704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.258000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.258278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.258955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.260903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.281119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1354/2728] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:32:40 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:40.285163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.295949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87a2ba-1249-4bf7-b0e9-162dfbbc1b48 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.300570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.301256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.301543 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.301841 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.302562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.304190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.314774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1375/2729] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:40.318822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.328870 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfc9fd-9f5d-4564-b665-d6a679a02ad2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.333486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.334357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.334645 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.334927 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] PATH_INFO: `/v3/projects/b9ef5063f74042cab5a1839334f80893/users/c7dd3137391f49079d78292641580c9d/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.350154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ef5063f74042cab5a1839334f80893, user_id=c7dd3137391f49079d78292641580c9d, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.353033 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.367078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1355/2730] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:40 2022] PUT /identity/v3/projects/b9ef5063f74042cab5a1839334f80893/users/c7dd3137391f49079d78292641580c9d/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:40.370997 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.381076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ce47-c6d4-45c5-b119-e1c4481c01cc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.393495 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:40.438783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2a78c-5721-4747-9280-48753a16e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.439448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a78c-5721-4747-9280-48753a16e522 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.439737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a78c-5721-4747-9280-48753a16e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.440019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2a78c-5721-4747-9280-48753a16e522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.440770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a78c-5721-4747-9280-48753a16e522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.442386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2a78c-5721-4747-9280-48753a16e522 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.452647 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1376/2731] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:40.456780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.467316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99b72c-6601-4018-a863-173475774c54 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.472004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.472916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.473202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.473480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] PATH_INFO: `/v3/projects/b9ef5063f74042cab5a1839334f80893/users/c7dd3137391f49079d78292641580c9d/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.475476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ef5063f74042cab5a1839334f80893, user_id=c7dd3137391f49079d78292641580c9d, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.478169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.488363 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1356/2732] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:40 2022] PUT /identity/v3/projects/b9ef5063f74042cab5a1839334f80893/users/c7dd3137391f49079d78292641580c9d/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:40.499912 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.500212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.500492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.526898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] MFA Rules not processed for user `c7dd3137391f49079d78292641580c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:40.528101 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:40.595311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1377/2733] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:40.607222 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.609081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:40.670809 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f702-a01f-4f09-b968-74109d2e11a2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.674599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.675249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.675536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.675816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.731065 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.733481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.742236 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1357/2734] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:42.213047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:42.214476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:42.226948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc834f56-4750-4ef8-ba8e-8a2f5c80a834 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:42.230488 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:42.231121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:42.231407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:42.231723 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:42.286983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:42.288348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:42.297295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1378/2735] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:42.819581 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:42.828057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531f54-6b76-4d71-b8a1-48825bcde8cd service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:42.831821 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642babf5-540b-4913-ae45-130626d5a1e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:42.832482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642babf5-540b-4913-ae45-130626d5a1e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:42.832770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642babf5-540b-4913-ae45-130626d5a1e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:42.833081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642babf5-540b-4913-ae45-130626d5a1e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:42.842049 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642babf5-540b-4913-ae45-130626d5a1e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:42.843487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642babf5-540b-4913-ae45-130626d5a1e1 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:42.852902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1358/2736] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:46.668643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:46.710075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:46.732471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767ce54-2eb7-4fae-ab67-facf800f4318 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:46.737006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:46.737867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:46.738149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:46.738424 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] PATH_INFO: `/v3/users/61946667877447e0bdf6514583a56f43` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:46.739585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=61946667877447e0bdf6514583a56f43)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:46.741555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:46.788068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61946667877447e0bdf6514583a56f43'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:46.799950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61946667877447e0bdf6514583a56f43'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:46.807383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61946667877447e0bdf6514583a56f43'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:46.814337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61946667877447e0bdf6514583a56f43'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:46.814977 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61946667877447e0bdf6514583a56f43'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:46.820773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1379/2737] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:32:46 2022] DELETE /identity/v3/users/61946667877447e0bdf6514583a56f43 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:46.825841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:46.826529 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:46.826691 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:46.844260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:46.845494 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:46.887980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:46.906996 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1359/2738] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:46.916551 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:46.918084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:46.978892 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046152-30c5-4673-bb8f-46dc611482aa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:46.983523 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:46.984173 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:46.984479 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:46.984745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:46.993862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:46.995300 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:47.005187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1380/2739] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:47.269903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:47.271375 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:47.284432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa85406-faaa-4bdb-b369-cb46ddf367e2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:47.289169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:47.290042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:47.290316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:47.290595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] PATH_INFO: `/v3/projects/c643c82bdb4e4ab4804bf753c59b3c7b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:47.291794 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c643c82bdb4e4ab4804bf753c59b3c7b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:47.293764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:47.341697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c643c82bdb4e4ab4804bf753c59b3c7b', 'request_id': 'req-bb52c3fd-0907-4d55-a288-4ab250cfd5de'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.347871 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c643c82bdb4e4ab4804bf753c59b3c7b', 'request_id': 'req-bb52c3fd-0907-4d55-a288-4ab250cfd5de'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.356669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c643c82bdb4e4ab4804bf753c59b3c7b', 'request_id': 'req-bb52c3fd-0907-4d55-a288-4ab250cfd5de'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.367818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] The token cache is being invalidate because project c643c82bdb4e4ab4804bf753c59b3c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:32:47.368093 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.368742 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.370482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1360/2740] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:32:47 2022] DELETE /identity/v3/projects/c643c82bdb4e4ab4804bf753c59b3c7b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:47.374676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:47.384515 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dda28-14bb-4e7a-a7eb-863dbdda1a2c service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:47.443468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:47.444366 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:47.444656 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:47.444974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] PATH_INFO: `/v3/users/8d27c960c92a411e875a074157de8557` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:47.446175 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d27c960c92a411e875a074157de8557)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:47.448141 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:47.449662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:47.503489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d27c960c92a411e875a074157de8557'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.515700 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d27c960c92a411e875a074157de8557'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.522831 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d27c960c92a411e875a074157de8557'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.530518 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d27c960c92a411e875a074157de8557'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.531143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d27c960c92a411e875a074157de8557'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.536975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1381/2741] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:32:47 2022] DELETE /identity/v3/users/8d27c960c92a411e875a074157de8557 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:47.802960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:47.804520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:47.818628 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c3fd-0907-4d55-a288-4ab250cfd5de admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:47.877155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:47.878015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:47.878296 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:47.878570 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] PATH_INFO: `/v3/projects/c6254694673a44c2ba268879054d424f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:47.879741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6254694673a44c2ba268879054d424f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:47.881688 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:47.927931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6254694673a44c2ba268879054d424f', 'request_id': 'req-a7878585-596a-4a7f-bcfb-111e348e1f37'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.933906 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6254694673a44c2ba268879054d424f', 'request_id': 'req-a7878585-596a-4a7f-bcfb-111e348e1f37'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.941338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6254694673a44c2ba268879054d424f', 'request_id': 'req-a7878585-596a-4a7f-bcfb-111e348e1f37'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.948430 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:47.952705 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] The token cache is being invalidate because project c6254694673a44c2ba268879054d424f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:32:47.953394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.954244 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:47.955839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1361/2742] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:32:47 2022] DELETE /identity/v3/projects/c6254694673a44c2ba268879054d424f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:47.959811 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:47.961278 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:47.974626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327973-0c93-4198-b663-d213f3d5ec06 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.032360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.033255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.033540 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.033819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] PATH_INFO: `/v3/users/c7dd3137391f49079d78292641580c9d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.034987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7dd3137391f49079d78292641580c9d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.036935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:48.083054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7dd3137391f49079d78292641580c9d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.095690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7dd3137391f49079d78292641580c9d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.103116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7dd3137391f49079d78292641580c9d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.110349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7dd3137391f49079d78292641580c9d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.111008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acecdc91-7332-4d6c-8092-522f92027438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7dd3137391f49079d78292641580c9d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.112491 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:48.117838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1382/2743] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:32:47 2022] DELETE /identity/v3/users/c7dd3137391f49079d78292641580c9d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:48.431949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:48.433845 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:48.448260 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7878585-596a-4a7f-bcfb-111e348e1f37 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.511943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.513515 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.513835 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.514117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] PATH_INFO: `/v3/projects/b9ef5063f74042cab5a1839334f80893` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.515417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ef5063f74042cab5a1839334f80893)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.517392 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:48.567143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ef5063f74042cab5a1839334f80893', 'request_id': 'req-09f9994e-35fb-4fb2-a9f6-bc321a6645af'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.573477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ef5063f74042cab5a1839334f80893', 'request_id': 'req-09f9994e-35fb-4fb2-a9f6-bc321a6645af'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.582830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ef5063f74042cab5a1839334f80893', 'request_id': 'req-09f9994e-35fb-4fb2-a9f6-bc321a6645af'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.597463 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] The token cache is being invalidate because project b9ef5063f74042cab5a1839334f80893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:32:48.597921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.598791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09f9994e-35fb-4fb2-a9f6-bc321a6645af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:32:48.600391 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1362/2744] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:32:48 2022] DELETE /identity/v3/projects/b9ef5063f74042cab5a1839334f80893 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:48.606155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1592c-b1ec-4d45-8dcd-3bff6599938d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.606687 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1592c-b1ec-4d45-8dcd-3bff6599938d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.607084 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1592c-b1ec-4d45-8dcd-3bff6599938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.626292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-33e1592c-b1ec-4d45-8dcd-3bff6599938d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:48.627576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-33e1592c-b1ec-4d45-8dcd-3bff6599938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:48.693280 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1383/2745] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:48.703238 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c000e-c338-4a57-a934-e63f613ab662 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.703526 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c000e-c338-4a57-a934-e63f613ab662 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.703812 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c000e-c338-4a57-a934-e63f613ab662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.723110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c55c000e-c338-4a57-a934-e63f613ab662 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:48.724372 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c55c000e-c338-4a57-a934-e63f613ab662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:48.733473 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1363/2746] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:48.737929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1592c-b1ec-4d45-8dcd-3bff6599938d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:48.750131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1592c-b1ec-4d45-8dcd-3bff6599938d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.755154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.755819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.756104 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.756516 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.757754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:32:48.758068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.760356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:48.777310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1384/2747] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:32:48.781973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c000e-c338-4a57-a934-e63f613ab662 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:48.791471 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c000e-c338-4a57-a934-e63f613ab662 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.797555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.798083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.798083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.798454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.799165 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.801115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:48.829999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1364/2748] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:32:48 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:48.834416 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:48.847650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbce97-0be9-4ff2-870e-09ba62e66e1d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.913557 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.914236 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.914530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.914815 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.915528 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.917506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:48.939152 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1385/2749] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:32:48 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:32:48.943253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:48.954488 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c015ed-57d3-48c2-a2d5-51a7ffdf890d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.959142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.959793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.960075 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.960348 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.961135 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.962712 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:48.973600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1365/2750] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:48.977589 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:48.988482 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689abf8-778e-46b5-b047-0bc9886ee0fb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.993283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72b80b-4dae-4640-8192-05b5c615f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.993960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72b80b-4dae-4640-8192-05b5c615f267 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.994252 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72b80b-4dae-4640-8192-05b5c615f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.994558 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72b80b-4dae-4640-8192-05b5c615f267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.995319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72b80b-4dae-4640-8192-05b5c615f267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.997702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72b80b-4dae-4640-8192-05b5c615f267 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:49.007742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1386/2751] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:32:49.011693 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:49.021741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e820c33-8b9c-47ef-a235-28dfe7e1a483 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:49.026659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:49.027596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:49.027830 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:49.028112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] PATH_INFO: `/v3/projects/99b2255c58db4d38b46a1f1d0b5fffc7/users/a14aae842a824db7a1a59c80460d46d0/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:49.042861 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b2255c58db4d38b46a1f1d0b5fffc7, user_id=a14aae842a824db7a1a59c80460d46d0, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:49.046403 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:49.059101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1366/2752] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:32:49 2022] PUT /identity/v3/projects/99b2255c58db4d38b46a1f1d0b5fffc7/users/a14aae842a824db7a1a59c80460d46d0/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:32:49.064763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aeea6-846c-4cf2-99e8-80afc7a5354b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:49.065112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aeea6-846c-4cf2-99e8-80afc7a5354b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:49.065406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aeea6-846c-4cf2-99e8-80afc7a5354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:49.082853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-803aeea6-846c-4cf2-99e8-80afc7a5354b None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:49.084053 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-803aeea6-846c-4cf2-99e8-80afc7a5354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:49.142471 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1387/2753] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:49.152352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:49.154142 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:49.188591 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:49.222565 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386c91-3d30-4df5-b3eb-4e2d12ffdc2d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:49.226278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:49.226923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:49.227206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:49.227484 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:49.237233 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:49.238700 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:49.248460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1367/2754] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:49.845978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc235d-7063-4e49-bef7-4014405cc7c1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:49.846272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc235d-7063-4e49-bef7-4014405cc7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:49.846559 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc235d-7063-4e49-bef7-4014405cc7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:49.853182 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:49.874410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-75cc235d-7063-4e49-bef7-4014405cc7c1 None None] MFA Rules not processed for user `a14aae842a824db7a1a59c80460d46d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:49.875730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-75cc235d-7063-4e49-bef7-4014405cc7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:49.946149 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1388/2755] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:49.957675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:49.959115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:50.017394 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08b196-0d28-4d50-b092-724887fcc783 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:50.023555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80b28e-e5f0-4674-9f03-5333ac3dc54b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:50.024720 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80b28e-e5f0-4674-9f03-5333ac3dc54b service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:50.025041 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80b28e-e5f0-4674-9f03-5333ac3dc54b service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:50.025325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80b28e-e5f0-4674-9f03-5333ac3dc54b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:50.034378 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80b28e-e5f0-4674-9f03-5333ac3dc54b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:50.035822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80b28e-e5f0-4674-9f03-5333ac3dc54b service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:50.045037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1368/2756] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:51.382923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692816dd-87e1-4d46-8cd1-3fb6fc8724b0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:51.383476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692816dd-87e1-4d46-8cd1-3fb6fc8724b0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:51.383476 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692816dd-87e1-4d46-8cd1-3fb6fc8724b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:51.401678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-692816dd-87e1-4d46-8cd1-3fb6fc8724b0 None None] MFA Rules not processed for user `a14aae842a824db7a1a59c80460d46d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:51.402891 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-692816dd-87e1-4d46-8cd1-3fb6fc8724b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:51.410556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1389/2757] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:32:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:00.040651 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=40 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:01.396124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:51.486118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:51.486758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:51.486758 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:51.504667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] MFA Rules not processed for user `a14aae842a824db7a1a59c80460d46d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:51.505883 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:51.526503 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1369/2758] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:33:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:01.520807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=9 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:56.236040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636fa22-15e7-4972-be67-6e1246836fdd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:56.236574 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636fa22-15e7-4972-be67-6e1246836fdd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:56.236691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636fa22-15e7-4972-be67-6e1246836fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:56.265398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1636fa22-15e7-4972-be67-6e1246836fdd None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:56.266626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1636fa22-15e7-4972-be67-6e1246836fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:56.324760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1390/2759] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Jul 21 05:34:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:56.371824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:56.373285 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:56.444902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafe19d-4a65-49e0-b328-f600adee487b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:56.449954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:56.451117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:56.451425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:56.451817 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:56.460044 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:56.461695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:56.470623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1370/2760] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 05:34:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:35:06.317751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=29 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:06.466770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=32 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:11.832682 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:11.833213 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:11.833350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:11.852223 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] MFA Rules not processed for user `ae32108815704de987d20434ea951c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:11.853448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:11.861256 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1391/2761] 10.222.0.45 () {58 vars in 967 bytes} [Thu Jul 21 05:35:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:11.874118 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:11.884677 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9cd2-a97e-4c34-b019-2c03c093f619 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:11.889799 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e73243951044e4b5beb3de4ebb0a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:11.890434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:11.890723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:11.891007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:11.899320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:11.900930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:11.909785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1371/2762] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Jul 21 05:35:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:35:13.748762 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:13.750233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:13.800735 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:13.812120 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960403f7-df81-456d-ace7-8c4c3fa68782 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:13.816864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:13.817731 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:13.818501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:13.818795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] PATH_INFO: `/v3/users/a14aae842a824db7a1a59c80460d46d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:13.820017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14aae842a824db7a1a59c80460d46d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:13.822174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:13.822962 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f0f56-1d51-410e-a7c5-b2cb7067750e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:13.830367 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:13.831088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:13.831450 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:13.831801 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:13.833710 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:13.846317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:13.847911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:13.859653 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1392/2763] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:35:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:35:13.875696 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14aae842a824db7a1a59c80460d46d0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:13.890616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14aae842a824db7a1a59c80460d46d0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:13.891328 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14aae842a824db7a1a59c80460d46d0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:13.899007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14aae842a824db7a1a59c80460d46d0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:13.906136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-13acdd3e-b431-40f2-8029-f19637d3704c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14aae842a824db7a1a59c80460d46d0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:13.911928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1372/2764] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:35:13 2022] DELETE /identity/v3/users/a14aae842a824db7a1a59c80460d46d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:35:14.090982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.104956 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a657-5d88-4e72-9b4f-b66b7666a594 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.166806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.167786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.168155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.168446 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] PATH_INFO: `/v3/projects/99b2255c58db4d38b46a1f1d0b5fffc7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.170322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b2255c58db4d38b46a1f1d0b5fffc7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.172260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.219926 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b2255c58db4d38b46a1f1d0b5fffc7', 'request_id': 'req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:14.227838 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b2255c58db4d38b46a1f1d0b5fffc7', 'request_id': 'req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:14.234363 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b2255c58db4d38b46a1f1d0b5fffc7', 'request_id': 'req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:14.246187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] The token cache is being invalidate because project 99b2255c58db4d38b46a1f1d0b5fffc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:35:14.246475 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:14.247763 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a5ba9d2c-3d3a-443f-9511-33b037d53b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:14.249836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1393/2765] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:35:14 2022] DELETE /identity/v3/projects/99b2255c58db4d38b46a1f1d0b5fffc7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:35:14.254706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b1d0-b1ba-4092-a371-4c316627ca39 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.254992 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b1d0-b1ba-4092-a371-4c316627ca39 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.255265 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b1d0-b1ba-4092-a371-4c316627ca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.274138 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e544b1d0-b1ba-4092-a371-4c316627ca39 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:14.275343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e544b1d0-b1ba-4092-a371-4c316627ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:14.337832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1373/2766] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:14.346390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8f9f-eb94-4bd2-b0e9-11d179c6305a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.346683 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8f9f-eb94-4bd2-b0e9-11d179c6305a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.346975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8f9f-eb94-4bd2-b0e9-11d179c6305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.366511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-916a8f9f-eb94-4bd2-b0e9-11d179c6305a None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:14.367648 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-916a8f9f-eb94-4bd2-b0e9-11d179c6305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:14.376499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1394/2767] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:14.380668 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b1d0-b1ba-4092-a371-4c316627ca39 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.391112 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b1d0-b1ba-4092-a371-4c316627ca39 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.395755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.396418 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.396708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.397023 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.397762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:35:14.398077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.400239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.415269 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1374/2768] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:35:14.416521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a8f9f-eb94-4bd2-b0e9-11d179c6305a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.426310 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a8f9f-eb94-4bd2-b0e9-11d179c6305a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.431046 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.431711 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.431999 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.432282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.433018 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.435642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.439229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:14.465085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1395/2769] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:35:14 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:35:14.469173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.479312 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086d54a-6ec5-4f67-8c2f-368b607ea8de admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.528287 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:14.543801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.545810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.546099 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.546374 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.547090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.549032 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.569752 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1375/2770] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:35:14 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:35:14.573786 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.585112 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a833663-748a-4f43-b8cc-d13d3f7a51fe admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.590258 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.591466 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.591754 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.592157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.592936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.594544 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.607679 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1396/2771] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:35:14.609115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.619536 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9038-45c1-4efa-ad34-aa354b2490d1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.625218 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b3f51-d88f-464a-94e5-7aecdac688ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.626042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b3f51-d88f-464a-94e5-7aecdac688ae admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.626332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b3f51-d88f-464a-94e5-7aecdac688ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.626614 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b3f51-d88f-464a-94e5-7aecdac688ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.627347 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b3f51-d88f-464a-94e5-7aecdac688ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.628988 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b3f51-d88f-464a-94e5-7aecdac688ae admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.640345 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1376/2772] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:35:14.644302 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.659116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9e4b6-d842-46b4-bfd8-1306905c67b6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.663816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce933cb-b07d-4c37-a210-b8e69850ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.664701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce933cb-b07d-4c37-a210-b8e69850ae44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.665014 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce933cb-b07d-4c37-a210-b8e69850ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.665296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce933cb-b07d-4c37-a210-b8e69850ae44 admin admin] PATH_INFO: `/v3/projects/187b592bb7ca4f1c8111ec14b4e0fdb2/users/762e65612e494a73b2719d2462cfeacb/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.684194 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce933cb-b07d-4c37-a210-b8e69850ae44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187b592bb7ca4f1c8111ec14b4e0fdb2, user_id=762e65612e494a73b2719d2462cfeacb, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.687661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce933cb-b07d-4c37-a210-b8e69850ae44 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.702279 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1397/2773] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:35:14 2022] PUT /identity/v3/projects/187b592bb7ca4f1c8111ec14b4e0fdb2/users/762e65612e494a73b2719d2462cfeacb/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:35:14.712332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238027-7f7c-4f06-898a-0bc26c43e619 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.712630 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238027-7f7c-4f06-898a-0bc26c43e619 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.712955 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238027-7f7c-4f06-898a-0bc26c43e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.740226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-62238027-7f7c-4f06-898a-0bc26c43e619 None None] MFA Rules not processed for user `762e65612e494a73b2719d2462cfeacb`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:14.741818 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-62238027-7f7c-4f06-898a-0bc26c43e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:14.808240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1377/2774] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:14.819737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.820180 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.820290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.868971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] MFA Rules not processed for user `061cc3a23d944f18b311eb2aa9a651d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:14.870229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:14.931666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1398/2775] 10.222.0.45 () {58 vars in 1063 bytes} [Thu Jul 21 05:35:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:14.938388 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238027-7f7c-4f06-898a-0bc26c43e619 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:14.947864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238027-7f7c-4f06-898a-0bc26c43e619 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:14.951892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061cc3a23d944f18b311eb2aa9a651d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:14.952535 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:14.952911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:14.953109 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:14.961960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:14.963405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:14.972662 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1378/2776] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:35:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:35:24.928781 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=59,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:24.968641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=51,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:28.556029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:28.557474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:28.646805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1dc8-f087-4e68-a783-ca6adb8a8947 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:28.652083 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff58f-1b55-4e70-a8fd-33a59660da9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:28.652727 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff58f-1b55-4e70-a8fd-33a59660da9a service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:28.653044 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff58f-1b55-4e70-a8fd-33a59660da9a service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:28.653324 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff58f-1b55-4e70-a8fd-33a59660da9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:28.655094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-758ff58f-1b55-4e70-a8fd-33a59660da9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:28.667073 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff58f-1b55-4e70-a8fd-33a59660da9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:28.668660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff58f-1b55-4e70-a8fd-33a59660da9a service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:28.679836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1399/2777] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:35:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:35:38.675602 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:41.515669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:41.577987 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb175ca8-a114-4c93-96c8-0261be021691 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:41.583336 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:41.584193 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:41.584482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:41.584765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] PATH_INFO: `/v3/users/762e65612e494a73b2719d2462cfeacb` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:41.585984 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762e65612e494a73b2719d2462cfeacb)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:41.587916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:41.633549 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762e65612e494a73b2719d2462cfeacb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:41.646004 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762e65612e494a73b2719d2462cfeacb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:41.646675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762e65612e494a73b2719d2462cfeacb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:41.655853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762e65612e494a73b2719d2462cfeacb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:41.662203 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762e65612e494a73b2719d2462cfeacb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:41.668249 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1379/2778] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:35:41 2022] DELETE /identity/v3/users/762e65612e494a73b2719d2462cfeacb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:35:41.673292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:41.673690 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:41.673861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:41.692163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:41.693407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:41.751068 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1400/2779] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:41.760460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:41.761938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:41.819795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ea877-386a-4a7d-99f7-85f09b9910e6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:41.823499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67559e-a3dd-41a4-9a2e-7bb4d03f8139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:41.824144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67559e-a3dd-41a4-9a2e-7bb4d03f8139 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:41.824434 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67559e-a3dd-41a4-9a2e-7bb4d03f8139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:41.824717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67559e-a3dd-41a4-9a2e-7bb4d03f8139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:41.834325 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67559e-a3dd-41a4-9a2e-7bb4d03f8139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:41.835764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67559e-a3dd-41a4-9a2e-7bb4d03f8139 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:41.845898 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1380/2780] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:35:42.115345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.116875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:42.129746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc0dc-7db7-4b76-9a61-1f971f2180e4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.134298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.135269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.135560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.135840 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] PATH_INFO: `/v3/projects/187b592bb7ca4f1c8111ec14b4e0fdb2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.137058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187b592bb7ca4f1c8111ec14b4e0fdb2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.138975 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.186497 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187b592bb7ca4f1c8111ec14b4e0fdb2', 'request_id': 'req-c155d468-3171-412a-9db4-2a7deb0929e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:42.194601 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187b592bb7ca4f1c8111ec14b4e0fdb2', 'request_id': 'req-c155d468-3171-412a-9db4-2a7deb0929e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:42.200320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187b592bb7ca4f1c8111ec14b4e0fdb2', 'request_id': 'req-c155d468-3171-412a-9db4-2a7deb0929e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:42.212263 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] The token cache is being invalidate because project 187b592bb7ca4f1c8111ec14b4e0fdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:35:42.212554 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:42.213204 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c155d468-3171-412a-9db4-2a7deb0929e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:35:42.214726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1401/2781] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:35:42 2022] DELETE /identity/v3/projects/187b592bb7ca4f1c8111ec14b4e0fdb2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:35:42.219860 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0f6b-0326-45e2-a5bb-023478299d5c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.220158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0f6b-0326-45e2-a5bb-023478299d5c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.220445 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0f6b-0326-45e2-a5bb-023478299d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.238525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ae4a0f6b-0326-45e2-a5bb-023478299d5c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:42.239734 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ae4a0f6b-0326-45e2-a5bb-023478299d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:42.257292 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:42.300908 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1381/2782] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:42.308806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e23ce-75a7-416f-8571-c2ca90f40a82 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.309132 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e23ce-75a7-416f-8571-c2ca90f40a82 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.309418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e23ce-75a7-416f-8571-c2ca90f40a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.327737 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e31e23ce-75a7-416f-8571-c2ca90f40a82 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:42.329592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e31e23ce-75a7-416f-8571-c2ca90f40a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:42.337878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1402/2783] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:42.341930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a0f6b-0326-45e2-a5bb-023478299d5c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.351902 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a0f6b-0326-45e2-a5bb-023478299d5c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.356523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.357216 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.357507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.357791 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.358521 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:35:42.358833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.360462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.371940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1382/2784] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:35:42.376783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e23ce-75a7-416f-8571-c2ca90f40a82 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.385968 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e23ce-75a7-416f-8571-c2ca90f40a82 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.390614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.391901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.392187 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.392467 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.393200 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.395096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.420333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1403/2785] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:35:42 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:35:42.424405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.434500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855deb-8709-43d5-870a-b8bb4834d236 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.489807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.490460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.490746 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.491028 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.491733 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.493678 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.513925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1383/2786] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:35:42 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:35:42.518660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.529047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850c97-aa98-413a-ac24-303c4d492c99 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.533729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.534378 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.534663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.534950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.535665 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.537295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.548246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1404/2787] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:35:42.552064 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.561911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1c806-2bf6-4d23-bb93-036c186b7e61 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.567308 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad9ac0-76de-4b66-87d5-d51cbd0bc203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.567954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad9ac0-76de-4b66-87d5-d51cbd0bc203 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.568240 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad9ac0-76de-4b66-87d5-d51cbd0bc203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.568517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad9ac0-76de-4b66-87d5-d51cbd0bc203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.569278 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad9ac0-76de-4b66-87d5-d51cbd0bc203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.570899 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad9ac0-76de-4b66-87d5-d51cbd0bc203 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.580739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1384/2788] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:35:42.584572 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.594542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a183-b73e-4ecd-96e8-f627ffbd1164 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.599290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.600161 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.600443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.600720 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] PATH_INFO: `/v3/projects/3aed90f07df84384b83752df001c4c1e/users/6c8781550b5c458885ba23af8c6d32c7/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.615832 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aed90f07df84384b83752df001c4c1e, user_id=6c8781550b5c458885ba23af8c6d32c7, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.618549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.632193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1405/2789] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:35:42 2022] PUT /identity/v3/projects/3aed90f07df84384b83752df001c4c1e/users/6c8781550b5c458885ba23af8c6d32c7/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:35:42.637357 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f4d6-84de-4cea-85df-94516abcbbd7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.637652 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f4d6-84de-4cea-85df-94516abcbbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.637936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f4d6-84de-4cea-85df-94516abcbbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.655609 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d561f4d6-84de-4cea-85df-94516abcbbd7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:42.656915 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d561f4d6-84de-4cea-85df-94516abcbbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:42.716676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1385/2790] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:42.726298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:42.728011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:42.750871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:42.788426 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c282-d43a-41f1-a5b2-b21390832649 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:42.792143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:42.792783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:42.793102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:42.793412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:42.803107 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:42.804486 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:42.814561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1406/2791] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:35:46.974319 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1df94-4f43-417a-a13e-7500feaede21 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:46.974766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1df94-4f43-417a-a13e-7500feaede21 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:46.976107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1df94-4f43-417a-a13e-7500feaede21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:47.004694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d0b1df94-4f43-417a-a13e-7500feaede21 None None] MFA Rules not processed for user `6c8781550b5c458885ba23af8c6d32c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:47.005965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d0b1df94-4f43-417a-a13e-7500feaede21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:47.024695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:35:47.076134 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1386/2792] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:47.081218 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:47.091645 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6431db0-3ef8-4368-98c1-396afb352d86 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:47.098453 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:47.099125 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:47.099414 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:47.099698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:47.100407 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:47.102350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:47.129531 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1407/2793] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:35:47 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:35:47.133722 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1df94-4f43-417a-a13e-7500feaede21 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:47.145113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1df94-4f43-417a-a13e-7500feaede21 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:47.201778 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:47.202370 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:47.202658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:47.202941 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:47.204166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:47.206136 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:47.226643 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1387/2794] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:35:47 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:35:47.230608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:47.240906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b857b-981d-4843-bc21-7451b1eae650 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:47.245490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:47.246153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:47.246438 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:47.246717 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:47.247437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:47.249074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:47.259549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1408/2795] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:35:47.263663 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:47.275176 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c24a-ce1e-4dac-9523-60f0af80ebea admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:47.279949 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:47.280892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:47.281162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:47.282078 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] PATH_INFO: `/v3/projects/f52de9bf2b984cfbb9a39ae0119474ef/users/4c22fd970a364831ab7c086ec546d98b/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:47.297454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52de9bf2b984cfbb9a39ae0119474ef, user_id=4c22fd970a364831ab7c086ec546d98b, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:47.300141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:47.314141 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1388/2796] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:35:47 2022] PUT /identity/v3/projects/f52de9bf2b984cfbb9a39ae0119474ef/users/4c22fd970a364831ab7c086ec546d98b/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:35:47.318349 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:47.329139 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68186fc-846a-4cfb-ae95-13a37906818f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:47.384396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625c60e-171d-4316-beac-eb22f1e52134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:47.385100 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625c60e-171d-4316-beac-eb22f1e52134 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:47.385394 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625c60e-171d-4316-beac-eb22f1e52134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:47.385680 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625c60e-171d-4316-beac-eb22f1e52134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:47.386409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625c60e-171d-4316-beac-eb22f1e52134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:47.388019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625c60e-171d-4316-beac-eb22f1e52134 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:47.398235 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1409/2797] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:35:47.402616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:35:47.413973 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753d29c-ca49-4f8d-be1f-0ea2461c7577 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:35:47.418706 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04fa1d-4ac8-4014-bd5f-9986ba3e9364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:35:47.419596 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04fa1d-4ac8-4014-bd5f-9986ba3e9364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:47.419881 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04fa1d-4ac8-4014-bd5f-9986ba3e9364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:47.420158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04fa1d-4ac8-4014-bd5f-9986ba3e9364 admin admin] PATH_INFO: `/v3/projects/f52de9bf2b984cfbb9a39ae0119474ef/users/4c22fd970a364831ab7c086ec546d98b/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:47.422857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04fa1d-4ac8-4014-bd5f-9986ba3e9364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52de9bf2b984cfbb9a39ae0119474ef, user_id=4c22fd970a364831ab7c086ec546d98b, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:35:47.425697 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04fa1d-4ac8-4014-bd5f-9986ba3e9364 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:35:47.437266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1389/2798] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:35:47 2022] PUT /identity/v3/projects/f52de9bf2b984cfbb9a39ae0119474ef/users/4c22fd970a364831ab7c086ec546d98b/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:35:51.931193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:35:51.931193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:35:51.932524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:35:51.981284 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] MFA Rules not processed for user `4c22fd970a364831ab7c086ec546d98b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:35:51.983397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:35:52.079702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1410/2799] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:35:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:35:57.433204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:02.072862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:55.187816 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e524-07d5-4c81-af6c-473cb0ec76b1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:55.188721 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e524-07d5-4c81-af6c-473cb0ec76b1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:55.189043 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e524-07d5-4c81-af6c-473cb0ec76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:55.227868 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9094e524-07d5-4c81-af6c-473cb0ec76b1 None None] MFA Rules not processed for user `3357f08257be47b58cf048c12daabfad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:36:55.229137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9094e524-07d5-4c81-af6c-473cb0ec76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:55.322878 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1390/2800] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Jul 21 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:36:55.335847 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:55.337312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:55.353932 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcc208-1d09-44f1-baba-a32d0bf3e20e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:55.363876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:55.364418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:55.365024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:55.365296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:55.375496 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:55.377229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:55.387548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1411/2801] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:36:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:36:58.409666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e524-07d5-4c81-af6c-473cb0ec76b1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:58.478831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e524-07d5-4c81-af6c-473cb0ec76b1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:58.483859 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:58.484738 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:58.485059 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:58.485343 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] PATH_INFO: `/v3/users/6c8781550b5c458885ba23af8c6d32c7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:58.487119 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8781550b5c458885ba23af8c6d32c7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:58.489097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:58.539045 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8781550b5c458885ba23af8c6d32c7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.551543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8781550b5c458885ba23af8c6d32c7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.552223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8781550b5c458885ba23af8c6d32c7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.559507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8781550b5c458885ba23af8c6d32c7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.567204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8781550b5c458885ba23af8c6d32c7'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.573129 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1391/2802] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:36:58 2022] DELETE /identity/v3/users/6c8781550b5c458885ba23af8c6d32c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:36:58.749137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:58.760168 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268dfd9-0778-43c6-8327-11f01e4ee46f service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:58.819390 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:58.820177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:58.820458 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:58.820732 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] PATH_INFO: `/v3/projects/3aed90f07df84384b83752df001c4c1e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:58.821929 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aed90f07df84384b83752df001c4c1e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:58.823857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:58.870215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aed90f07df84384b83752df001c4c1e', 'request_id': 'req-73333d67-f3ad-4a8d-ada9-367adf70ce1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.877381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aed90f07df84384b83752df001c4c1e', 'request_id': 'req-73333d67-f3ad-4a8d-ada9-367adf70ce1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.883019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aed90f07df84384b83752df001c4c1e', 'request_id': 'req-73333d67-f3ad-4a8d-ada9-367adf70ce1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.894319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] The token cache is being invalidate because project 3aed90f07df84384b83752df001c4c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:36:58.894607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.895239 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:58.896751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1412/2803] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:36:58 2022] DELETE /identity/v3/projects/3aed90f07df84384b83752df001c4c1e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:36:58.901031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:58.902460 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:58.911303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:58.917801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d346ab-8428-4254-bff8-ebfa54667f1f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:58.976763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:58.977656 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:58.977940 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:58.978220 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] PATH_INFO: `/v3/users/4c22fd970a364831ab7c086ec546d98b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:58.979405 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c22fd970a364831ab7c086ec546d98b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:58.981365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:59.026704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c22fd970a364831ab7c086ec546d98b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.039115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c22fd970a364831ab7c086ec546d98b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.039785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c22fd970a364831ab7c086ec546d98b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.047916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c22fd970a364831ab7c086ec546d98b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.055148 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c22fd970a364831ab7c086ec546d98b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.060961 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1392/2804] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:36:58 2022] DELETE /identity/v3/users/4c22fd970a364831ab7c086ec546d98b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:36:59.238674 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:59.240113 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:59.254617 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73333d67-f3ad-4a8d-ada9-367adf70ce1a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:59.311678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:59.312566 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:59.312875 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:59.313153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] PATH_INFO: `/v3/projects/f52de9bf2b984cfbb9a39ae0119474ef` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:59.314315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52de9bf2b984cfbb9a39ae0119474ef)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:59.316774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:59.338231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:59.364174 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52de9bf2b984cfbb9a39ae0119474ef', 'request_id': 'req-32bbe4ee-6a0f-4e1c-9464-12050f441faf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.371215 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52de9bf2b984cfbb9a39ae0119474ef', 'request_id': 'req-32bbe4ee-6a0f-4e1c-9464-12050f441faf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.376808 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52de9bf2b984cfbb9a39ae0119474ef', 'request_id': 'req-32bbe4ee-6a0f-4e1c-9464-12050f441faf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.388348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] The token cache is being invalidate because project f52de9bf2b984cfbb9a39ae0119474ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:36:59.388635 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.389290 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:59.390824 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1413/2805] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:36:59 2022] DELETE /identity/v3/projects/f52de9bf2b984cfbb9a39ae0119474ef => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:37:09.057501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:37:09.385320 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:37:15.161606 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:37:15.163031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:37:15.233753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9ae4-b857-440b-a247-6cfc87035d2c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:37:15.287067 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:37:15.287727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:15.288018 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:15.288303 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:15.290080 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:37:15.300116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:37:15.301595 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:37:15.309499 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1393/2806] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:37:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:37:25.306007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=51 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:33.428624 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.430103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.545931 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbe4ee-6a0f-4e1c-9464-12050f441faf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.551099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862cf15-234c-45e6-800f-7bafd8437c14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.551751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862cf15-234c-45e6-800f-7bafd8437c14 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.552042 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862cf15-234c-45e6-800f-7bafd8437c14 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.552323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862cf15-234c-45e6-800f-7bafd8437c14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.554126 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4862cf15-234c-45e6-800f-7bafd8437c14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.566245 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862cf15-234c-45e6-800f-7bafd8437c14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.567800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862cf15-234c-45e6-800f-7bafd8437c14 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.578216 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1414/2807] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:43.574136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=48 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:20.175634 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:20.177117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:20.217327 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0bd40-a3f4-437f-aeaa-f2b6d72ceb5b service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:20.220989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:20.221658 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:20.221946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:20.222226 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:20.229475 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:20.230911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:20.238795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1394/2808] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:30.235283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=19 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:24.282344 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb80cd-269b-404e-94dc-2cfb8dc8a5a7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:24.283058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb80cd-269b-404e-94dc-2cfb8dc8a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:24.283058 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb80cd-269b-404e-94dc-2cfb8dc8a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:24.330611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-eebb80cd-269b-404e-94dc-2cfb8dc8a5a7 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:24.331837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eebb80cd-269b-404e-94dc-2cfb8dc8a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:24.397876 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1415/2809] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:43:24.408813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:24.410251 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:24.421681 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e80c-77b6-484e-a8bb-455f3a2088e1 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:24.425889 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31c056-b67c-4156-b299-bb574e16bbd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:24.426532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c056-b67c-4156-b299-bb574e16bbd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:24.426806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c056-b67c-4156-b299-bb574e16bbd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:24.427087 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c056-b67c-4156-b299-bb574e16bbd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:24.436055 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31c056-b67c-4156-b299-bb574e16bbd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:24.437509 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31c056-b67c-4156-b299-bb574e16bbd0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:24.447480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1395/2810] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:26.913904 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d81cd5-0ad2-407d-a6d4-e8a8b6cf506e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:26.914701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d81cd5-0ad2-407d-a6d4-e8a8b6cf506e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:26.914868 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d81cd5-0ad2-407d-a6d4-e8a8b6cf506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:26.967744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92d81cd5-0ad2-407d-a6d4-e8a8b6cf506e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:26.969006 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92d81cd5-0ad2-407d-a6d4-e8a8b6cf506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:26.977560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1416/2811] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:26.985567 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14c3d7-2dc1-4036-9690-d71ef5294115 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:26.986125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14c3d7-2dc1-4036-9690-d71ef5294115 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:26.986306 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14c3d7-2dc1-4036-9690-d71ef5294115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.005707 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4e14c3d7-2dc1-4036-9690-d71ef5294115 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:27.006954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4e14c3d7-2dc1-4036-9690-d71ef5294115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:27.015364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1396/2812] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:27.020057 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d81cd5-0ad2-407d-a6d4-e8a8b6cf506e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.030277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d81cd5-0ad2-407d-a6d4-e8a8b6cf506e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.034967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.035773 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.036059 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.036338 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.037103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:43:27.037412 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.039012 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.052045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1417/2813] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:43:27.056582 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14c3d7-2dc1-4036-9690-d71ef5294115 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.066833 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14c3d7-2dc1-4036-9690-d71ef5294115 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.071694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.072349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.072633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.072946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.073647 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.075553 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.113399 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1397/2814] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:27.117590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.127664 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ad55-3bf5-40fd-bc06-eded20d80124 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.185282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.185891 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.186183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.186470 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.187163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.189195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.210480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1418/2815] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:27.214666 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.225946 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81de59c-d115-4cd6-9292-6d5041686d10 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.230805 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.231477 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.231762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.232039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.232766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.234408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.249123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1398/2816] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:27.253339 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.263282 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f38b-a57d-4db9-9200-3201ef37a93e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.268596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bfdae-be0f-4331-bccc-c49fd7c0f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.269293 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bfdae-be0f-4331-bccc-c49fd7c0f4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.269576 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bfdae-be0f-4331-bccc-c49fd7c0f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.269850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bfdae-be0f-4331-bccc-c49fd7c0f4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.270567 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bfdae-be0f-4331-bccc-c49fd7c0f4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.272151 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bfdae-be0f-4331-bccc-c49fd7c0f4c2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.277315 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:27.284171 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1419/2817] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:27.287599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.297804 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e4057-f888-4792-b10a-b9ef8d65fc62 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.302497 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.303365 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.303646 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.303921 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] PATH_INFO: `/v3/projects/4c0761bbadff47dbb280d77ccb9df1e2/users/94fc49eae3fd4008a284001023d29ee9/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.318631 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0761bbadff47dbb280d77ccb9df1e2, user_id=94fc49eae3fd4008a284001023d29ee9, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.321316 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.334846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1399/2818] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:43:27 2022] PUT /identity/v3/projects/4c0761bbadff47dbb280d77ccb9df1e2/users/94fc49eae3fd4008a284001023d29ee9/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:27.340005 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3c5d2-e871-4fdf-a791-03aee2a75cb1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.340299 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3c5d2-e871-4fdf-a791-03aee2a75cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.340585 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3c5d2-e871-4fdf-a791-03aee2a75cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.358618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3a3c5d2-e871-4fdf-a791-03aee2a75cb1 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:27.359819 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3a3c5d2-e871-4fdf-a791-03aee2a75cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:27.418886 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1420/2819] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:27.429204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.485931 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0797cc-8029-4c56-8e06-5689e7eab458 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.489676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.490320 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.490611 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.490894 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.500669 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.502739 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.512202 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1400/2820] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:31.187626 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c886a-b98f-40ea-9789-b6f77e542e12 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:31.188102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c886a-b98f-40ea-9789-b6f77e542e12 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:31.188226 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c886a-b98f-40ea-9789-b6f77e542e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:31.217432 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c79c886a-b98f-40ea-9789-b6f77e542e12 None None] MFA Rules not processed for user `94fc49eae3fd4008a284001023d29ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:31.218668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c79c886a-b98f-40ea-9789-b6f77e542e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:31.411958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1421/2821] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:37.508074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=63,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:41.409199 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=59 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:40.417229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:40.418912 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:40.521813 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18304a29-8fb1-4af6-8ae1-11d059e15a34 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:40.526980 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:40.527621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:40.527911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:40.528194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:40.536541 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:40.538168 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:40.548978 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1401/2822] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:50.544601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=47 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:34.709830 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c886a-b98f-40ea-9789-b6f77e542e12 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:34.759927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c886a-b98f-40ea-9789-b6f77e542e12 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:34.779130 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:34.779857 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:34.780154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:34.780443 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:34.782709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:34.790958 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:34.799155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:34.803007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:34.804597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350266-4dba-4f30-8e44-49a8da153252 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:34.810133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:34.811015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:34.811304 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:34.811585 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] PATH_INFO: `/v3/users/94fc49eae3fd4008a284001023d29ee9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:34.813015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fc49eae3fd4008a284001023d29ee9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:34.815282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:34.816461 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1422/2823] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:34.868352 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fc49eae3fd4008a284001023d29ee9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:34.880305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fc49eae3fd4008a284001023d29ee9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:34.881031 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fc49eae3fd4008a284001023d29ee9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:34.889708 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fc49eae3fd4008a284001023d29ee9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:34.896679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07c46253-55db-45e6-b577-74da875f74db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fc49eae3fd4008a284001023d29ee9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:34.902945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1402/2824] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:34 2022] DELETE /identity/v3/users/94fc49eae3fd4008a284001023d29ee9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:35.077640 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.089768 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756338e-45ec-4884-9134-6aa12fb28b7e service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.149743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.150618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.150907 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.151191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] PATH_INFO: `/v3/projects/4c0761bbadff47dbb280d77ccb9df1e2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.152388 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0761bbadff47dbb280d77ccb9df1e2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.154308 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.200323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0761bbadff47dbb280d77ccb9df1e2', 'request_id': 'req-51d912ae-c2be-4416-a17d-9c75f6297951'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:35.208007 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0761bbadff47dbb280d77ccb9df1e2', 'request_id': 'req-51d912ae-c2be-4416-a17d-9c75f6297951'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:35.214296 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0761bbadff47dbb280d77ccb9df1e2', 'request_id': 'req-51d912ae-c2be-4416-a17d-9c75f6297951'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:35.227452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] The token cache is being invalidate because project 4c0761bbadff47dbb280d77ccb9df1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:35.227739 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:35.228413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-51d912ae-c2be-4416-a17d-9c75f6297951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:35.229966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1423/2825] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:35 2022] DELETE /identity/v3/projects/4c0761bbadff47dbb280d77ccb9df1e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:35.234934 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da50248-8809-4334-a2ad-1029b8288f41 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.235229 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da50248-8809-4334-a2ad-1029b8288f41 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.235517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da50248-8809-4334-a2ad-1029b8288f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.253695 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8da50248-8809-4334-a2ad-1029b8288f41 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:35.254903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8da50248-8809-4334-a2ad-1029b8288f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:35.313451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1403/2826] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:35.321398 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304b335-708e-44ed-a280-f2fe0bce8c69 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.321691 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304b335-708e-44ed-a280-f2fe0bce8c69 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.321974 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304b335-708e-44ed-a280-f2fe0bce8c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.340621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8304b335-708e-44ed-a280-f2fe0bce8c69 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:35.341861 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8304b335-708e-44ed-a280-f2fe0bce8c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:35.350016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1424/2827] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:35.354905 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da50248-8809-4334-a2ad-1029b8288f41 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.364616 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da50248-8809-4334-a2ad-1029b8288f41 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.369502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.370151 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.370437 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.370718 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.371443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:35.371755 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.373395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.384863 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1404/2828] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:35.389195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304b335-708e-44ed-a280-f2fe0bce8c69 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.398254 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304b335-708e-44ed-a280-f2fe0bce8c69 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.403493 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.404133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.404417 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.404694 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.405413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.407292 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.433490 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1425/2829] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:35 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:35.437660 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.448575 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff581-d7fe-4919-92ac-7bcd14745bf0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.505913 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.506573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.506857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.507133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.507849 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.510166 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.516716 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:35.531286 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1405/2830] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:35 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:35.535387 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.546489 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b723652-b82f-45d4-8b1c-00713d63b31e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.551075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.551726 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.552011 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.552289 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.553047 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.554658 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.564972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1426/2831] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:35.568683 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.579174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fdb84-f8ba-4a56-93af-10f1f22c6d8e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.583775 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886422a-d5d7-49dc-bd87-7c0d0719e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.584424 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886422a-d5d7-49dc-bd87-7c0d0719e560 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.584711 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886422a-d5d7-49dc-bd87-7c0d0719e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.585021 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886422a-d5d7-49dc-bd87-7c0d0719e560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.585770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886422a-d5d7-49dc-bd87-7c0d0719e560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.588243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886422a-d5d7-49dc-bd87-7c0d0719e560 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.598110 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1406/2832] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:35.602409 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.612294 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d64b-d68a-4485-867e-b5ac0af5f5ca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.616805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.617753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.618056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.618336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] PATH_INFO: `/v3/projects/6001ea08f5c340f89088f03c453d7e87/users/4b6af686679a40fe956ee01eb702d438/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.632441 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6001ea08f5c340f89088f03c453d7e87, user_id=4b6af686679a40fe956ee01eb702d438, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.635646 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.644650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:35.658064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1427/2833] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:35 2022] PUT /identity/v3/projects/6001ea08f5c340f89088f03c453d7e87/users/4b6af686679a40fe956ee01eb702d438/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:35.661741 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.662037 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.662332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.688334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] MFA Rules not processed for user `4b6af686679a40fe956ee01eb702d438`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:35.689632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:35.752727 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1407/2834] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:35.764530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:35.766311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:35.844714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de75749-6bf9-44c9-bfbd-56c09ecf1d78 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:35.848288 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:35.848958 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:35.849242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:35.849520 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:35.857779 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:35.859410 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:35.868356 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1428/2835] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:46:45.749853 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:45.864192 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=35 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:26.125443 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:26.127007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:26.197480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df4b7-e1d7-475b-9f06-658fd83def83 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:26.201143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:26.201795 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:26.202081 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:26.202364 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:26.204137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:26.213569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:26.215003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:26.222895 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1408/2836] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:47:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:47:36.219382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=31 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:47.383758 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:47.385191 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:47.472287 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68006e50-d93f-48c4-af88-2c340ee2dfc3 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:47.477311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:47.477957 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:47.478240 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:47.478524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:47.480275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:47.492243 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:47.493848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:47.503650 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1429/2837] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:57.499449 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=39 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:30.150426 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:52:30.186893 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd600d92-2373-43a2-8ccb-f2820cc655ef service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:52:30.190601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:52:30.191242 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:52:30.191530 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:52:30.191815 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:52:30.199839 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:52:30.201324 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:52:30.210106 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1409/2838] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:52:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:52:40.205760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=18 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:54.384995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:55:54.386401 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:55:54.444013 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0accca-801f-43dc-8ca9-4cdf21c74988 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:55:54.450032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:55:54.451609 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:55:54.452040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:55:54.452499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:55:54.462654 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:55:54.464242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:55:54.474253 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1430/2839] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:55:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:56:04.470072 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=24 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:34.117155 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:34.118748 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:34.186339 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584f648-b7f1-4c54-912a-b4e61dafaa75 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:34.190661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:34.191425 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:34.191719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:34.192000 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:34.193903 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:34.203619 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:34.205085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:34.213766 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1410/2840] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:38.916916 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:38.918505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:38.996902 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdb9e0-796d-4d99-b3b9-2bce39fcaac1 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:39.000487 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18485afa-c716-49cf-9752-c939928e4bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:39.001157 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485afa-c716-49cf-9752-c939928e4bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:39.001448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485afa-c716-49cf-9752-c939928e4bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:39.001730 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485afa-c716-49cf-9752-c939928e4bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:39.003642 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-18485afa-c716-49cf-9752-c939928e4bf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:39.095777 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18485afa-c716-49cf-9752-c939928e4bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:39.097848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18485afa-c716-49cf-9752-c939928e4bf9 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:39.116079 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1431/2841] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:40.243807 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:40.245439 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:40.341982 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd949b8-05e9-4626-a8c6-0e98ab6d860c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:40.346550 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:40.347998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:40.348281 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:40.348560 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] PATH_INFO: `/v3/users/4b6af686679a40fe956ee01eb702d438` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:40.349787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6af686679a40fe956ee01eb702d438)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:40.351719 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:40.398338 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6af686679a40fe956ee01eb702d438'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.410783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6af686679a40fe956ee01eb702d438'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.411451 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6af686679a40fe956ee01eb702d438'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.413116 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:40.424340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6af686679a40fe956ee01eb702d438'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.432227 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6af686679a40fe956ee01eb702d438'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.438125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1411/2842] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:57:40 2022] DELETE /identity/v3/users/4b6af686679a40fe956ee01eb702d438 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:40.443121 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:40.443596 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:40.443693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:40.470138 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:40.471329 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:40.512784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:40.530186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1432/2843] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:40.541140 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:40.542539 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:40.598760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adfa3d-ee5c-4fe9-b714-c5e39facb6cd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:40.602454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f21713-bde7-4d79-907f-22eadd18e349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:40.603094 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f21713-bde7-4d79-907f-22eadd18e349 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:40.603383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f21713-bde7-4d79-907f-22eadd18e349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:40.603832 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f21713-bde7-4d79-907f-22eadd18e349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:40.617770 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f21713-bde7-4d79-907f-22eadd18e349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:40.619284 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f21713-bde7-4d79-907f-22eadd18e349 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:40.629622 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1412/2844] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:40.900588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:40.902076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:40.914060 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595be9-c3ef-4708-ae45-e6b19277fb6e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:40.918936 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:40.919747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:40.920024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:40.920305 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] PATH_INFO: `/v3/projects/6001ea08f5c340f89088f03c453d7e87` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:40.921521 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6001ea08f5c340f89088f03c453d7e87)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:40.924383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:40.974509 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6001ea08f5c340f89088f03c453d7e87', 'request_id': 'req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.981822 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6001ea08f5c340f89088f03c453d7e87', 'request_id': 'req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.987612 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6001ea08f5c340f89088f03c453d7e87', 'request_id': 'req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.999052 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] The token cache is being invalidate because project 6001ea08f5c340f89088f03c453d7e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:57:40.999341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:40.999996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-71ca4ae8-87af-41a2-a2a8-7fae6d932a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:41.001568 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1433/2845] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:57:40 2022] DELETE /identity/v3/projects/6001ea08f5c340f89088f03c453d7e87 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:41.015253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4086f-4c37-4223-8bb1-f2c9f6110717 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.015492 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4086f-4c37-4223-8bb1-f2c9f6110717 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.015779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4086f-4c37-4223-8bb1-f2c9f6110717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.063601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-46f4086f-4c37-4223-8bb1-f2c9f6110717 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:41.064801 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-46f4086f-4c37-4223-8bb1-f2c9f6110717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:41.122633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1413/2846] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:41.180980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de78258-167b-4004-a47b-0ab42a6e858d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.181269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de78258-167b-4004-a47b-0ab42a6e858d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.181549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de78258-167b-4004-a47b-0ab42a6e858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.200054 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2de78258-167b-4004-a47b-0ab42a6e858d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:41.201306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2de78258-167b-4004-a47b-0ab42a6e858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:41.209076 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1434/2847] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:57:41.213158 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4086f-4c37-4223-8bb1-f2c9f6110717 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.222638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4086f-4c37-4223-8bb1-f2c9f6110717 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.227144 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.227790 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.228073 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.228350 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.229102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:57:41.229408 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.231010 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.242769 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1414/2848] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:57:41.246871 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de78258-167b-4004-a47b-0ab42a6e858d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.256709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de78258-167b-4004-a47b-0ab42a6e858d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.261313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.261949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.262229 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.262506 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.263181 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.265074 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.300960 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1435/2849] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:57:41 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:41.305461 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.315442 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787839f-d5a1-4a5e-865d-35038ffccdd6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.360077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:41.374011 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.374674 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.374956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.375232 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.375925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.377887 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.398009 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1415/2850] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:57:41 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:41.402155 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.412743 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27a73a-9ac5-4dca-a66e-ddaa3197351b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.417625 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.418275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.418562 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.418839 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.419555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.421185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.431883 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1436/2851] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:41.435786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.445639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcefa9-0f30-42ff-849a-0ec62071fca5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.450537 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff12ce3-d1ee-4904-9c51-48493871bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.451196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff12ce3-d1ee-4904-9c51-48493871bd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.451504 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff12ce3-d1ee-4904-9c51-48493871bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.451780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff12ce3-d1ee-4904-9c51-48493871bd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.452525 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff12ce3-d1ee-4904-9c51-48493871bd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.454152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff12ce3-d1ee-4904-9c51-48493871bd5f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.464062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1416/2852] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:41.468166 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.478618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f6f5-1cc8-4864-a6d8-91ca140bc0bb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.483167 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.484048 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.484328 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.484604 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] PATH_INFO: `/v3/projects/5fbdf3a6b535426e8c322a0100597e94/users/cf01e6a1e91e428ca7872594f3cf090d/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.499579 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbdf3a6b535426e8c322a0100597e94, user_id=cf01e6a1e91e428ca7872594f3cf090d, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.502230 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.514829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1437/2853] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:41 2022] PUT /identity/v3/projects/5fbdf3a6b535426e8c322a0100597e94/users/cf01e6a1e91e428ca7872594f3cf090d/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:41.525030 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67a23-6326-4b3e-aea2-79bafb3a0590 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.525423 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67a23-6326-4b3e-aea2-79bafb3a0590 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.525717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67a23-6326-4b3e-aea2-79bafb3a0590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.552892 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-04b67a23-6326-4b3e-aea2-79bafb3a0590 None None] MFA Rules not processed for user `cf01e6a1e91e428ca7872594f3cf090d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:41.554070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-04b67a23-6326-4b3e-aea2-79bafb3a0590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:41.617633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1417/2854] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:41.622251 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.680746 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:41.685147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce2ce-318e-4b11-aa35-802145d86d1c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.691383 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.692298 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.692800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.693297 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.694225 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.696143 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.720186 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1438/2855] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:57:41 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:41.725027 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67a23-6326-4b3e-aea2-79bafb3a0590 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.735600 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67a23-6326-4b3e-aea2-79bafb3a0590 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.792456 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.793160 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.793449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.793732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.794417 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.796349 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.816137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1418/2856] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:57:41 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:41.820094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.830317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f9d62-293d-4226-b75b-c43047aac315 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.835651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.836311 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.836599 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.836913 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.837643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.839255 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.850233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1439/2857] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:41.854333 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.864169 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819016c-9976-4ea1-b772-2a059842006a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.868771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.869661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.869945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.870223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] PATH_INFO: `/v3/projects/801260233ea949158eb7f8854c0738d4/users/8b10baea0cbb4f0b9652e8d52a5b969f/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.884679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] RBAC: Authorizing `identity:create_grant(project_id=801260233ea949158eb7f8854c0738d4, user_id=8b10baea0cbb4f0b9652e8d52a5b969f, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.887502 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.902390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1419/2858] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:41 2022] PUT /identity/v3/projects/801260233ea949158eb7f8854c0738d4/users/8b10baea0cbb4f0b9652e8d52a5b969f/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:41.906452 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:41.917019 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f6f39-3ed4-4822-a59c-4a35e54ce2e4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:41.974008 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f920a6-8caa-4aa6-8cde-919a710ead84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:41.974678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f920a6-8caa-4aa6-8cde-919a710ead84 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:41.974967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f920a6-8caa-4aa6-8cde-919a710ead84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:41.975242 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f920a6-8caa-4aa6-8cde-919a710ead84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:41.975966 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f920a6-8caa-4aa6-8cde-919a710ead84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:41.977610 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f920a6-8caa-4aa6-8cde-919a710ead84 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:41.987457 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1440/2859] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:41.992149 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:42.002648 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17aa18-85f1-4772-8180-52398510595e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:42.008183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:42.009103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:42.009390 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:42.009670 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] PATH_INFO: `/v3/projects/801260233ea949158eb7f8854c0738d4/users/8b10baea0cbb4f0b9652e8d52a5b969f/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:42.011692 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801260233ea949158eb7f8854c0738d4, user_id=8b10baea0cbb4f0b9652e8d52a5b969f, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:42.014383 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:42.024486 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1420/2860] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:41 2022] PUT /identity/v3/projects/801260233ea949158eb7f8854c0738d4/users/8b10baea0cbb4f0b9652e8d52a5b969f/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:42.034560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df79c-f905-41bb-a275-b1de38516fb5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:42.034849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df79c-f905-41bb-a275-b1de38516fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:42.035133 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df79c-f905-41bb-a275-b1de38516fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:42.061728 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-117df79c-f905-41bb-a275-b1de38516fb5 None None] MFA Rules not processed for user `8b10baea0cbb4f0b9652e8d52a5b969f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:42.062967 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-117df79c-f905-41bb-a275-b1de38516fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:42.129685 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1441/2861] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:42.141245 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:42.142947 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:42.153667 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:42.202070 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445016a8-c525-40df-b85e-14cfd6f832f1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:42.205771 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:42.206414 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:42.207462 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:42.207659 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:42.216732 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:42.218211 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:42.227798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1421/2862] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:42.322783 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df79c-f905-41bb-a275-b1de38516fb5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:42.332766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df79c-f905-41bb-a275-b1de38516fb5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:42.336323 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd3107-84e3-4a78-ba06-c4a1f7a993f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:42.336985 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd3107-84e3-4a78-ba06-c4a1f7a993f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:42.337268 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd3107-84e3-4a78-ba06-c4a1f7a993f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:42.337546 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd3107-84e3-4a78-ba06-c4a1f7a993f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:42.383714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:42.393742 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd3107-84e3-4a78-ba06-c4a1f7a993f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:42.395927 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd3107-84e3-4a78-ba06-c4a1f7a993f4 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:42.404906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1442/2863] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:44.955465 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:45.016633 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a843644-d8cb-4ef9-a027-e18731163c99 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:45.022076 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:45.022938 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:45.023225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:45.023507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] PATH_INFO: `/v3/users/cf01e6a1e91e428ca7872594f3cf090d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:45.024759 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf01e6a1e91e428ca7872594f3cf090d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:45.026753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:45.071890 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf01e6a1e91e428ca7872594f3cf090d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.084513 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf01e6a1e91e428ca7872594f3cf090d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.085219 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf01e6a1e91e428ca7872594f3cf090d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.092561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf01e6a1e91e428ca7872594f3cf090d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.100197 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf01e6a1e91e428ca7872594f3cf090d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.106056 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1422/2864] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:57:44 2022] DELETE /identity/v3/users/cf01e6a1e91e428ca7872594f3cf090d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:45.110573 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:45.111067 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:45.111163 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:45.129725 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:45.130948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:45.188629 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1443/2865] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:57:45.198361 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:45.199774 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:45.234382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:45.259786 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764aea7-0622-4aee-acf7-6f3fb493e497 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:45.263474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:45.264114 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:45.264401 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:45.264680 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:45.273753 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:45.275185 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:45.285305 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1423/2866] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:45.545948 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:45.547381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:45.559360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e263b78-2626-4181-8857-6e2a8cc6eef4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:45.564198 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:45.565090 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:45.565371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:45.565641 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] PATH_INFO: `/v3/projects/5fbdf3a6b535426e8c322a0100597e94` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:45.567061 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbdf3a6b535426e8c322a0100597e94)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:45.568991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:45.616511 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbdf3a6b535426e8c322a0100597e94', 'request_id': 'req-475e1289-bfeb-4150-b84f-40e9adc9ebf7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.623588 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbdf3a6b535426e8c322a0100597e94', 'request_id': 'req-475e1289-bfeb-4150-b84f-40e9adc9ebf7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.629360 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbdf3a6b535426e8c322a0100597e94', 'request_id': 'req-475e1289-bfeb-4150-b84f-40e9adc9ebf7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.640190 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] The token cache is being invalidate because project 5fbdf3a6b535426e8c322a0100597e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:57:45.640477 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.641116 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.642628 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1444/2867] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:57:45 2022] DELETE /identity/v3/projects/5fbdf3a6b535426e8c322a0100597e94 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:45.647103 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:45.656956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429042c0-0e17-431c-9e30-d94e9c286861 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:45.717077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:45.717953 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:45.718412 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:45.718704 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] PATH_INFO: `/v3/users/8b10baea0cbb4f0b9652e8d52a5b969f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:45.719897 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b10baea0cbb4f0b9652e8d52a5b969f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:45.721963 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:45.768419 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b10baea0cbb4f0b9652e8d52a5b969f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.781085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b10baea0cbb4f0b9652e8d52a5b969f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.781744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b10baea0cbb4f0b9652e8d52a5b969f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.789143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b10baea0cbb4f0b9652e8d52a5b969f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.796089 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7e22ccb4-8030-4466-bf00-ac22c80b1d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b10baea0cbb4f0b9652e8d52a5b969f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:45.802098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1424/2868] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:57:45 2022] DELETE /identity/v3/users/8b10baea0cbb4f0b9652e8d52a5b969f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:46.078794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.080317 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:46.094381 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1289-bfeb-4150-b84f-40e9adc9ebf7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.152348 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.153249 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.153535 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.153816 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] PATH_INFO: `/v3/projects/801260233ea949158eb7f8854c0738d4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.154980 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801260233ea949158eb7f8854c0738d4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.156905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.173662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:46.205169 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801260233ea949158eb7f8854c0738d4', 'request_id': 'req-c0772275-b1af-407d-9978-d5f355ae6e18'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:46.213147 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801260233ea949158eb7f8854c0738d4', 'request_id': 'req-c0772275-b1af-407d-9978-d5f355ae6e18'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:46.218678 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801260233ea949158eb7f8854c0738d4', 'request_id': 'req-c0772275-b1af-407d-9978-d5f355ae6e18'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:46.235364 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] The token cache is being invalidate because project 801260233ea949158eb7f8854c0738d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:57:46.235655 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:46.236319 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c0772275-b1af-407d-9978-d5f355ae6e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:46.237938 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1445/2869] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:57:46 2022] DELETE /identity/v3/projects/801260233ea949158eb7f8854c0738d4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:46.242959 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e831-896c-4754-8e16-5e087afb681d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.243420 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e831-896c-4754-8e16-5e087afb681d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.243516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e831-896c-4754-8e16-5e087afb681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.262123 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-62e0e831-896c-4754-8e16-5e087afb681d None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:46.263341 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-62e0e831-896c-4754-8e16-5e087afb681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:46.312152 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:46.327256 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1425/2870] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:46.336474 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201800c-66e1-492b-aa0f-a047c262d6cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.336771 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201800c-66e1-492b-aa0f-a047c262d6cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.337086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201800c-66e1-492b-aa0f-a047c262d6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.354911 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b201800c-66e1-492b-aa0f-a047c262d6cd None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:46.356124 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b201800c-66e1-492b-aa0f-a047c262d6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:46.364753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1446/2871] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:46.369012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e831-896c-4754-8e16-5e087afb681d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.379254 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e831-896c-4754-8e16-5e087afb681d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.383876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.384533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.384838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.385124 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.385846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:57:46.386154 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.387772 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.399884 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1426/2872] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:57:46.404085 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201800c-66e1-492b-aa0f-a047c262d6cd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.413322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201800c-66e1-492b-aa0f-a047c262d6cd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.417949 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.418592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.418878 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.419160 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.419853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.421784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.447499 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1447/2873] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:57:46 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:46.451676 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.462360 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f11e86-2376-43cb-b7a3-8834379e84d8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.517413 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.518007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.518293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.518573 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.519793 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.521836 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.541480 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1427/2874] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:57:46 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:46.545776 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.556524 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2941e1-78ca-4379-afef-e3842d174298 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.561195 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.561849 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.562137 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.562421 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.563146 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.564747 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.574996 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1448/2875] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:46.578701 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.589180 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b593a-2b6d-452c-a7cd-fb2e52779578 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.593847 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88456fc5-4e0d-4829-8299-69d1db943851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.594496 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456fc5-4e0d-4829-8299-69d1db943851 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.594785 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456fc5-4e0d-4829-8299-69d1db943851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.595071 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456fc5-4e0d-4829-8299-69d1db943851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.595787 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88456fc5-4e0d-4829-8299-69d1db943851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.598335 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88456fc5-4e0d-4829-8299-69d1db943851 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.614620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1428/2876] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:46.618715 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.629537 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20ba72-4f56-4eab-99be-aba43e6b4774 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.634118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.634982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.635265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.635542 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] PATH_INFO: `/v3/projects/839c4da2721647b8b78ccc4204089d27/users/c7d7e131b4374ad8b662c8b5e5dfc0ad/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.650709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839c4da2721647b8b78ccc4204089d27, user_id=c7d7e131b4374ad8b662c8b5e5dfc0ad, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.653382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.666829 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1449/2877] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:46 2022] PUT /identity/v3/projects/839c4da2721647b8b78ccc4204089d27/users/c7d7e131b4374ad8b662c8b5e5dfc0ad/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:57:46.677101 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12e3e-333c-4032-830c-0b1094bb5ea9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.677395 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12e3e-333c-4032-830c-0b1094bb5ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.677682 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12e3e-333c-4032-830c-0b1094bb5ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.705062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3be12e3e-333c-4032-830c-0b1094bb5ea9 None None] MFA Rules not processed for user `c7d7e131b4374ad8b662c8b5e5dfc0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:46.706266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3be12e3e-333c-4032-830c-0b1094bb5ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:46.769764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1429/2878] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:57:46.774064 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.835835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed9de-c670-4f88-b8de-ee01fa917a79 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.840634 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.841393 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.841688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.841973 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.842681 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.844686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.870275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1450/2879] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:57:46 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:46.874347 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12e3e-333c-4032-830c-0b1094bb5ea9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.884968 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12e3e-333c-4032-830c-0b1094bb5ea9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.930161 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:46.943280 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.943943 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.944225 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.944522 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.945235 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.947143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:46.966253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1430/2880] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:57:46 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:46.970231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:46.981177 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cba384-db17-418f-af1b-aaa3ee1e33e0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:46.986049 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:46.986709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:46.987000 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:46.987283 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:46.988555 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:46.990185 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:47.001729 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1451/2881] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:47.005851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:47.015703 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038745c-6efe-4f4b-ba1f-5f3181b76703 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:47.021012 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:47.021822 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.022102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.022377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] PATH_INFO: `/v3/projects/778540cdceb6463b8f0a99e0017c6829/users/bf769ca230274761b3d3b8dc304fd2b0/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.037760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] RBAC: Authorizing `identity:create_grant(project_id=778540cdceb6463b8f0a99e0017c6829, user_id=bf769ca230274761b3d3b8dc304fd2b0, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:47.040458 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:47.053332 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1431/2882] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:47 2022] PUT /identity/v3/projects/778540cdceb6463b8f0a99e0017c6829/users/bf769ca230274761b3d3b8dc304fd2b0/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:57:47.057448 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:47.067622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494252ac-0452-41ab-ba0c-f0e72417b734 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:47.078702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:47.126102 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fb3ba-45e4-4337-9ee5-3537d4ac423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:47.126774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb3ba-45e4-4337-9ee5-3537d4ac423f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.127065 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb3ba-45e4-4337-9ee5-3537d4ac423f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.127347 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb3ba-45e4-4337-9ee5-3537d4ac423f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.128075 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fb3ba-45e4-4337-9ee5-3537d4ac423f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:47.130024 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fb3ba-45e4-4337-9ee5-3537d4ac423f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:47.139795 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1452/2883] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:47.144481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:47.154623 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de1137-a62b-433b-9ae4-e684310b141e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:47.159125 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:47.160615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.160936 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.161203 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] PATH_INFO: `/v3/projects/778540cdceb6463b8f0a99e0017c6829/users/bf769ca230274761b3d3b8dc304fd2b0/roles/b0c1afc284ad4d8aa049e2da36fe5f40` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.163170 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778540cdceb6463b8f0a99e0017c6829, user_id=bf769ca230274761b3d3b8dc304fd2b0, role_id=b0c1afc284ad4d8aa049e2da36fe5f40)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:47.165891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:47.175779 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1432/2884] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:47 2022] PUT /identity/v3/projects/778540cdceb6463b8f0a99e0017c6829/users/bf769ca230274761b3d3b8dc304fd2b0/roles/b0c1afc284ad4d8aa049e2da36fe5f40 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:47.187086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ca7e-fa62-4aa5-815c-c0cf23a43177 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.187548 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ca7e-fa62-4aa5-815c-c0cf23a43177 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.187636 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ca7e-fa62-4aa5-815c-c0cf23a43177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.214522 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-eac1ca7e-fa62-4aa5-815c-c0cf23a43177 None None] MFA Rules not processed for user `bf769ca230274761b3d3b8dc304fd2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:47.215798 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eac1ca7e-fa62-4aa5-815c-c0cf23a43177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:47.281992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1453/2885] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:47.293082 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:47.294792 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:47.352293 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c796c0-ba7d-4fee-bf88-8503f39bd0d1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:47.355990 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b1d7e-77a1-4f71-a346-cccdb6584d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:47.356650 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b1d7e-77a1-4f71-a346-cccdb6584d01 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.356971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b1d7e-77a1-4f71-a346-cccdb6584d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.357258 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b1d7e-77a1-4f71-a346-cccdb6584d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.366517 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b1d7e-77a1-4f71-a346-cccdb6584d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:47.367964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b1d7e-77a1-4f71-a346-cccdb6584d01 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:47.377291 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1433/2886] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:47.507651 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1ca7e-fa62-4aa5-815c-c0cf23a43177 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:47.569275 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1ca7e-fa62-4aa5-815c-c0cf23a43177 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:47.573718 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:47.574575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.574864 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.575150 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] PATH_INFO: `/v3/users/c7d7e131b4374ad8b662c8b5e5dfc0ad` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.576335 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d7e131b4374ad8b662c8b5e5dfc0ad)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:47.578286 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:47.618375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:47.625040 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d7e131b4374ad8b662c8b5e5dfc0ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:47.637402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d7e131b4374ad8b662c8b5e5dfc0ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:47.645183 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d7e131b4374ad8b662c8b5e5dfc0ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:47.652131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d7e131b4374ad8b662c8b5e5dfc0ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:47.652805 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d7e131b4374ad8b662c8b5e5dfc0ad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:47.658862 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1454/2887] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:57:47 2022] DELETE /identity/v3/users/c7d7e131b4374ad8b662c8b5e5dfc0ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:47.663441 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.663743 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.664077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.682015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:47.683223 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:47.742301 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1434/2888] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:47.751764 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:47.753866 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:47.811095 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bc41b-6d39-49dd-b9c0-e299374db74f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:47.814752 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:47.815406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:47.815693 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:47.816590 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:47.826088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:47.827745 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:47.837611 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1455/2889] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:48.101085 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:48.102657 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:48.115454 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec17cbc-c261-4309-aa9e-6895a78e5c66 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:48.120270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:48.121243 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:48.121599 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:48.121886 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] PATH_INFO: `/v3/projects/839c4da2721647b8b78ccc4204089d27` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:48.123083 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=839c4da2721647b8b78ccc4204089d27)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:48.125090 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:48.166062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:48.175257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839c4da2721647b8b78ccc4204089d27', 'request_id': 'req-9150b720-f545-4c89-b902-e58674dcb1cd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.183039 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839c4da2721647b8b78ccc4204089d27', 'request_id': 'req-9150b720-f545-4c89-b902-e58674dcb1cd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.190501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839c4da2721647b8b78ccc4204089d27', 'request_id': 'req-9150b720-f545-4c89-b902-e58674dcb1cd'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.201597 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] The token cache is being invalidate because project 839c4da2721647b8b78ccc4204089d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:57:48.201885 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.202601 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.204173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1435/2890] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:57:48 2022] DELETE /identity/v3/projects/839c4da2721647b8b78ccc4204089d27 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:48.208794 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:48.218400 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c51757-c199-4dd7-ae14-f1c55f2e1810 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:48.274833 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:48.275702 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:48.275988 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:48.276270 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] PATH_INFO: `/v3/users/bf769ca230274761b3d3b8dc304fd2b0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:48.277465 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf769ca230274761b3d3b8dc304fd2b0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:48.279375 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:48.324021 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf769ca230274761b3d3b8dc304fd2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.334837 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:48.337403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf769ca230274761b3d3b8dc304fd2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.345219 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf769ca230274761b3d3b8dc304fd2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.352748 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf769ca230274761b3d3b8dc304fd2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.353437 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9298b3e2-c4a8-4431-8e42-639d9c58b8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf769ca230274761b3d3b8dc304fd2b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.359413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1456/2891] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:57:48 2022] DELETE /identity/v3/users/bf769ca230274761b3d3b8dc304fd2b0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:48.639107 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:48.640569 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:48.654340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150b720-f545-4c89-b902-e58674dcb1cd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:48.715062 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:48.715918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:48.716204 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:48.716491 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] PATH_INFO: `/v3/projects/778540cdceb6463b8f0a99e0017c6829` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:48.717717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=778540cdceb6463b8f0a99e0017c6829)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:48.719625 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:48.768466 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778540cdceb6463b8f0a99e0017c6829', 'request_id': 'req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.775393 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778540cdceb6463b8f0a99e0017c6829', 'request_id': 'req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.782239 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778540cdceb6463b8f0a99e0017c6829', 'request_id': 'req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.793512 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] The token cache is being invalidate because project 778540cdceb6463b8f0a99e0017c6829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:57:48.793798 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.794440 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ad0acbcf-61e4-414f-b44b-5f1c336d55d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:48.795956 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1436/2892] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:57:48 2022] DELETE /identity/v3/projects/778540cdceb6463b8f0a99e0017c6829 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:48.800800 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412fddb-93d0-4e3c-942e-88d82f4f5b51 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:48.801128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412fddb-93d0-4e3c-942e-88d82f4f5b51 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:48.801418 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412fddb-93d0-4e3c-942e-88d82f4f5b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:48.820118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0412fddb-93d0-4e3c-942e-88d82f4f5b51 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:48.821371 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0412fddb-93d0-4e3c-942e-88d82f4f5b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:48.880430 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1457/2893] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:48.888139 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ddc8-20e9-4306-8c5a-36a308013333 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:48.888387 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ddc8-20e9-4306-8c5a-36a308013333 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:48.888694 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ddc8-20e9-4306-8c5a-36a308013333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:48.907555 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-56e4ddc8-20e9-4306-8c5a-36a308013333 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:48.908765 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-56e4ddc8-20e9-4306-8c5a-36a308013333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:48.916960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1437/2894] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:48.921119 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412fddb-93d0-4e3c-942e-88d82f4f5b51 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:48.931257 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412fddb-93d0-4e3c-942e-88d82f4f5b51 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:48.935785 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:48.936436 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:48.936724 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:48.937041 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:48.937770 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:57:48.938086 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:48.939684 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:48.952010 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1458/2895] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:57:48.957117 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ddc8-20e9-4306-8c5a-36a308013333 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:48.966464 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ddc8-20e9-4306-8c5a-36a308013333 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:48.971196 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:48.971841 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:48.972162 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:48.972446 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:48.973186 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:48.975097 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:49.000092 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1438/2896] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:57:48 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:49.005154 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:49.015901 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cf3d-9a16-4d6a-8ab2-ed32fd736db6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:49.070867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:49.071526 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:49.071809 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:49.072089 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:49.072774 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:49.074701 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:49.095403 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1459/2897] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:57:49 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:57:49.099468 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:49.109827 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09b6b2-1233-4de7-a55d-332f393a5c29 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:49.114552 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:49.115206 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:49.115495 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:49.115777 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:49.116501 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:49.118137 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:49.129422 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1439/2898] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:49.133136 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:49.143016 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b10f0-68c2-498b-8be9-ed5e95d3a8cf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:49.148402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ed9c6-5ef7-45de-be42-145a87d4e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:49.149094 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed9c6-5ef7-45de-be42-145a87d4e842 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:49.149382 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed9c6-5ef7-45de-be42-145a87d4e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:49.149663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed9c6-5ef7-45de-be42-145a87d4e842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:49.150386 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ed9c6-5ef7-45de-be42-145a87d4e842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:49.151970 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ed9c6-5ef7-45de-be42-145a87d4e842 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:49.163688 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1460/2899] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:49.167740 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:49.177838 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401abc-1468-4bc4-856b-dbcd9dc8ad76 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:49.182764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:49.183636 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:49.183974 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:49.184262 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] PATH_INFO: `/v3/projects/c332e1c1f0534e8f8fe8279c8dd4db6c/users/167b8403152845aea9e9b2f416ed3861/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:49.199181 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c332e1c1f0534e8f8fe8279c8dd4db6c, user_id=167b8403152845aea9e9b2f416ed3861, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:49.201937 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:49.204100 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:49.217449 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1440/2900] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:49 2022] PUT /identity/v3/projects/c332e1c1f0534e8f8fe8279c8dd4db6c/users/167b8403152845aea9e9b2f416ed3861/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:49.228668 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a38f9-4482-4463-945d-e7cfb2173048 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:49.229350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a38f9-4482-4463-945d-e7cfb2173048 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:49.229350 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a38f9-4482-4463-945d-e7cfb2173048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:49.256009 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c09a38f9-4482-4463-945d-e7cfb2173048 None None] MFA Rules not processed for user `167b8403152845aea9e9b2f416ed3861`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:49.257264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c09a38f9-4482-4463-945d-e7cfb2173048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:49.288941 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:49.324998 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1461/2901] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:49.336964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:49.338699 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:49.395945 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabcaa9-2519-4b5e-9d70-1b7c63de4625 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:49.400520 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc94552-33a5-4044-acba-e8cfffe3c9f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:49.401217 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc94552-33a5-4044-acba-e8cfffe3c9f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:49.401479 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc94552-33a5-4044-acba-e8cfffe3c9f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:49.401806 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc94552-33a5-4044-acba-e8cfffe3c9f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:49.411034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc94552-33a5-4044-acba-e8cfffe3c9f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:49.412533 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc94552-33a5-4044-acba-e8cfffe3c9f5 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:49.422113 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1441/2902] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:51.952983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a38f9-4482-4463-945d-e7cfb2173048 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:52.015176 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a38f9-4482-4463-945d-e7cfb2173048 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:52.019676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:52.020549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.020867 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.021153 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] PATH_INFO: `/v3/users/167b8403152845aea9e9b2f416ed3861` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.022345 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=167b8403152845aea9e9b2f416ed3861)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:52.024276 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:52.069923 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167b8403152845aea9e9b2f416ed3861'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.081622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167b8403152845aea9e9b2f416ed3861'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.088614 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167b8403152845aea9e9b2f416ed3861'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.095760 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167b8403152845aea9e9b2f416ed3861'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.096397 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167b8403152845aea9e9b2f416ed3861'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.102751 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1462/2903] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:57:51 2022] DELETE /identity/v3/users/167b8403152845aea9e9b2f416ed3861 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:52.107224 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.107724 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.107831 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.125624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:52.126837 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:52.185102 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1442/2904] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:52.194873 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:52.196295 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:52.253854 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebaf29-c4ea-4c12-ad26-ef7fd301e5de admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:52.257605 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c5fa3-936c-4f20-abd1-947dffaf8791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:52.258303 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5fa3-936c-4f20-abd1-947dffaf8791 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.258592 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5fa3-936c-4f20-abd1-947dffaf8791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.258874 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c5fa3-936c-4f20-abd1-947dffaf8791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.265843 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:52.268622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c5fa3-936c-4f20-abd1-947dffaf8791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:52.270928 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c5fa3-936c-4f20-abd1-947dffaf8791 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:52.282029 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1463/2905] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:57:52.546540 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:52.548066 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:52.560965 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80086afd-b22e-496f-92d2-4dff63f31a18 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:52.565624 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:52.566556 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.566904 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.567409 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] PATH_INFO: `/v3/projects/c332e1c1f0534e8f8fe8279c8dd4db6c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.569015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c332e1c1f0534e8f8fe8279c8dd4db6c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:52.571273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:52.623879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c332e1c1f0534e8f8fe8279c8dd4db6c', 'request_id': 'req-7383a211-32f3-4e22-b7d0-017c6658f0e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.630960 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c332e1c1f0534e8f8fe8279c8dd4db6c', 'request_id': 'req-7383a211-32f3-4e22-b7d0-017c6658f0e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.638406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c332e1c1f0534e8f8fe8279c8dd4db6c', 'request_id': 'req-7383a211-32f3-4e22-b7d0-017c6658f0e3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.649780 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] The token cache is being invalidate because project c332e1c1f0534e8f8fe8279c8dd4db6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:57:52.650077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.650745 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7383a211-32f3-4e22-b7d0-017c6658f0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:57:52.652300 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1443/2906] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:57:52 2022] DELETE /identity/v3/projects/c332e1c1f0534e8f8fe8279c8dd4db6c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:52.657621 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308eccc-8730-4948-b5e9-b2401299474f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.657915 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308eccc-8730-4948-b5e9-b2401299474f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.658201 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308eccc-8730-4948-b5e9-b2401299474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.676093 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c308eccc-8730-4948-b5e9-b2401299474f None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:52.677663 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c308eccc-8730-4948-b5e9-b2401299474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:52.737036 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1464/2907] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:52.746257 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3b17a-78ec-473e-b9de-6531167fdf6e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.746546 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3b17a-78ec-473e-b9de-6531167fdf6e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.746824 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3b17a-78ec-473e-b9de-6531167fdf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.764784 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-09b3b17a-78ec-473e-b9de-6531167fdf6e None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:52.765997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-09b3b17a-78ec-473e-b9de-6531167fdf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:52.773873 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1444/2908] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:57:52.777906 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308eccc-8730-4948-b5e9-b2401299474f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:52.788358 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308eccc-8730-4948-b5e9-b2401299474f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:52.792850 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:52.793502 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.793782 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.794088 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.794814 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:57:52.795120 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:52.796714 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:52.809631 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1465/2909] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:57:52.813744 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3b17a-78ec-473e-b9de-6531167fdf6e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:52.822891 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3b17a-78ec-473e-b9de-6531167fdf6e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:52.827561 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:52.828201 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.828483 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.828762 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.829482 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:52.831377 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:52.841210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:52.859641 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1445/2910] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:57:52 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:52.863735 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:52.873744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7ad31-f69f-4929-879f-feb4a1830e73 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:52.929337 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:52.930231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.930517 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.930792 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.931468 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:52.933406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:52.953817 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1466/2911] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:57:52 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:57:52.958621 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:52.968783 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e0a6-6249-4e87-ae50-aaa777b28cc9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:52.973639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:52.974299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:52.974587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:52.974865 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:52.975607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:52.977282 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:52.987171 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1446/2912] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:52.991539 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:53.001780 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094047-94ad-44c4-9cbb-bafd5c4ab9b5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:53.007561 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a175c8-3cb6-4197-b578-31af3ec85788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:53.008220 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a175c8-3cb6-4197-b578-31af3ec85788 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:53.008507 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a175c8-3cb6-4197-b578-31af3ec85788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:53.008787 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a175c8-3cb6-4197-b578-31af3ec85788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:53.009549 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a175c8-3cb6-4197-b578-31af3ec85788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:53.011127 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a175c8-3cb6-4197-b578-31af3ec85788 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:53.021222 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1467/2913] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:57:53.025128 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:53.034928 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20007e7a-da84-4f34-b204-c673f1c52eae admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:53.039608 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:53.040476 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:53.040760 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:53.041074 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] PATH_INFO: `/v3/projects/e128d0e159bc49d189cc6062ce2afb12/users/57a36d57c85d4c54a2ebcf65ec4c6fb8/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:53.056500 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e128d0e159bc49d189cc6062ce2afb12, user_id=57a36d57c85d4c54a2ebcf65ec4c6fb8, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:53.059299 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:53.072723 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1447/2914] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:57:53 2022] PUT /identity/v3/projects/e128d0e159bc49d189cc6062ce2afb12/users/57a36d57c85d4c54a2ebcf65ec4c6fb8/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:57:53.083026 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ce252-28c3-4fcb-9462-6bf8ef891c32 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:53.083336 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ce252-28c3-4fcb-9462-6bf8ef891c32 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:53.083618 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ce252-28c3-4fcb-9462-6bf8ef891c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:53.110853 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-922ce252-28c3-4fcb-9462-6bf8ef891c32 None None] MFA Rules not processed for user `57a36d57c85d4c54a2ebcf65ec4c6fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:57:53.112071 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-922ce252-28c3-4fcb-9462-6bf8ef891c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:53.158971 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:53.177131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1468/2915] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:57:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:57:53.189115 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:57:53.190867 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:57:53.246999 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c582f1-8313-4aef-8398-438909289281 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:57:53.250632 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4610b7-8ae7-4aae-b269-bcedfe8548d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:57:53.251267 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4610b7-8ae7-4aae-b269-bcedfe8548d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:57:53.251551 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4610b7-8ae7-4aae-b269-bcedfe8548d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:57:53.251829 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4610b7-8ae7-4aae-b269-bcedfe8548d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:57:53.260810 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4610b7-8ae7-4aae-b269-bcedfe8548d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:57:53.262270 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4610b7-8ae7-4aae-b269-bcedfe8548d9 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:57:53.271532 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1448/2916] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:57:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:58:03.173570 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:03.266930 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:26.940608 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ce252-28c3-4fcb-9462-6bf8ef891c32 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.002898 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ce252-28c3-4fcb-9462-6bf8ef891c32 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.007950 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.008806 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.009118 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.009396 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] PATH_INFO: `/v3/users/57a36d57c85d4c54a2ebcf65ec4c6fb8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.010603 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a36d57c85d4c54a2ebcf65ec4c6fb8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.012553 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:27.058848 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a36d57c85d4c54a2ebcf65ec4c6fb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.071103 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a36d57c85d4c54a2ebcf65ec4c6fb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.078935 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a36d57c85d4c54a2ebcf65ec4c6fb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.086333 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a36d57c85d4c54a2ebcf65ec4c6fb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.086992 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a36d57c85d4c54a2ebcf65ec4c6fb8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.092905 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1469/2917] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:58:26 2022] DELETE /identity/v3/users/57a36d57c85d4c54a2ebcf65ec4c6fb8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:58:27.097283 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.097764 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.097857 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.116615 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:58:27.117872 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:27.177487 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1449/2918] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:58:27.187312 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.188709 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:27.246402 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99014f22-050d-4eb3-88ae-d77bdeed1a26 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.250099 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ceb751-3f9b-4fa2-9175-e9226e96c55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.250744 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceb751-3f9b-4fa2-9175-e9226e96c55a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.251032 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceb751-3f9b-4fa2-9175-e9226e96c55a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.251313 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceb751-3f9b-4fa2-9175-e9226e96c55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.260480 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ceb751-3f9b-4fa2-9175-e9226e96c55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.261944 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ceb751-3f9b-4fa2-9175-e9226e96c55a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:27.271406 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1470/2919] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:58:27.538661 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.540130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:27.556199 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20e693-7b23-49d2-80ce-1853f065cb22 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.560911 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.561864 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.562046 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.562326 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] PATH_INFO: `/v3/projects/e128d0e159bc49d189cc6062ce2afb12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.563543 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e128d0e159bc49d189cc6062ce2afb12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.565506 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:27.611763 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e128d0e159bc49d189cc6062ce2afb12', 'request_id': 'req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.618511 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e128d0e159bc49d189cc6062ce2afb12', 'request_id': 'req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.626523 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e128d0e159bc49d189cc6062ce2afb12', 'request_id': 'req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.636773 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] The token cache is being invalidate because project e128d0e159bc49d189cc6062ce2afb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:58:27.637098 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.637725 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-692b9de6-454a-4ea9-b0a5-8b8d85695d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:27.639266 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1450/2920] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:58:27 2022] DELETE /identity/v3/projects/e128d0e159bc49d189cc6062ce2afb12 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:58:27.644096 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c64848-c83b-4a92-ac61-8c918ae66d43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.644391 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c64848-c83b-4a92-ac61-8c918ae66d43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.644686 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c64848-c83b-4a92-ac61-8c918ae66d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.662972 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-76c64848-c83b-4a92-ac61-8c918ae66d43 None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:58:27.664165 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-76c64848-c83b-4a92-ac61-8c918ae66d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:27.681423 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:27.726753 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1471/2921] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:58:27.735382 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3810-687b-4cc2-9475-ab77df8a788c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.735675 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3810-687b-4cc2-9475-ab77df8a788c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.735964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3810-687b-4cc2-9475-ab77df8a788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.753925 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a78a3810-687b-4cc2-9475-ab77df8a788c None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:58:27.755133 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a78a3810-687b-4cc2-9475-ab77df8a788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:27.762989 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1451/2922] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:58:27.767135 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c64848-c83b-4a92-ac61-8c918ae66d43 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.777392 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c64848-c83b-4a92-ac61-8c918ae66d43 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.781920 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.782560 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.782842 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.783115 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.783835 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:58:27.784144 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.786376 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:27.797845 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1472/2923] 10.222.0.45 () {58 vars in 1152 bytes} [Thu Jul 21 05:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:58:27.801918 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3810-687b-4cc2-9475-ab77df8a788c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.811334 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3810-687b-4cc2-9475-ab77df8a788c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.816042 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.816690 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.817016 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.817295 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.818017 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.819916 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:27.844997 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1452/2924] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Jul 21 05:58:27 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:58:27.849662 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.859775 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3adbd-c07e-48a8-a75d-0f88ee5a0cc7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.916331 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.917031 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.917322 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.917607 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.918306 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.920246 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:27.939389 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1473/2925] 10.222.0.45 () {60 vars in 1143 bytes} [Thu Jul 21 05:58:27 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:58:27.944340 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.954639 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67ab1-bf80-4504-ad0d-602df0e22647 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.959954 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.960607 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.960923 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.961207 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.961964 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.963548 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:27.973998 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1453/2926] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:58:27.977870 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:27.987660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b2c3b-1131-4d10-9459-ecfbcd6d1be2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:27.992698 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf245-fcd3-45f0-8188-7e139920a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:27.993380 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf245-fcd3-45f0-8188-7e139920a4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:27.993666 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf245-fcd3-45f0-8188-7e139920a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:27.993943 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf245-fcd3-45f0-8188-7e139920a4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:27.994661 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf245-fcd3-45f0-8188-7e139920a4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:27.996233 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf245-fcd3-45f0-8188-7e139920a4c4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:28.006983 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1474/2927] 10.222.0.45 () {58 vars in 1121 bytes} [Thu Jul 21 05:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:58:28.011015 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:28.021717 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa843f0d-f37e-4962-9a56-5e4d56fbbcdd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:28.026587 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:28.027686 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:28.028003 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:28.028290 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] PATH_INFO: `/v3/projects/bc1dfe4964ca400c96d5d77551fc76d8/users/6a653f8445f043f8b3375a9b1d8bf282/roles/d428254d31484e108ec67491b911bc1f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:28.043057 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1dfe4964ca400c96d5d77551fc76d8, user_id=6a653f8445f043f8b3375a9b1d8bf282, role_id=d428254d31484e108ec67491b911bc1f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:28.045796 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:28.058617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1454/2928] 10.222.0.45 () {60 vars in 1482 bytes} [Thu Jul 21 05:58:28 2022] PUT /identity/v3/projects/bc1dfe4964ca400c96d5d77551fc76d8/users/6a653f8445f043f8b3375a9b1d8bf282/roles/d428254d31484e108ec67491b911bc1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:58:28.069676 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ca55-ca3f-4172-9613-ae1ea51d7591 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:28.069978 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ca55-ca3f-4172-9613-ae1ea51d7591 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:28.070269 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ca55-ca3f-4172-9613-ae1ea51d7591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:28.097231 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2858ca55-ca3f-4172-9613-ae1ea51d7591 None None] MFA Rules not processed for user `6a653f8445f043f8b3375a9b1d8bf282`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:58:28.098530 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2858ca55-ca3f-4172-9613-ae1ea51d7591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:28.161991 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1475/2929] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:58:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:58:28.172481 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:28.174194 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:28.196851 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:28.233406 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56680454-9397-42d7-8993-fd3b290247b2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:28.237034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6180c2-4d80-4210-bee0-ff12a7f040d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '473f1bd4a95f4899a4a9a9927f14738c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:28.237679 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6180c2-4d80-4210-bee0-ff12a7f040d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:28.237971 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6180c2-4d80-4210-bee0-ff12a7f040d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:28.238255 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6180c2-4d80-4210-bee0-ff12a7f040d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:28.247188 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6180c2-4d80-4210-bee0-ff12a7f040d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:28.248638 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6180c2-4d80-4210-bee0-ff12a7f040d2 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:28.258143 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1455/2930] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:58:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:58:38.085667 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858ca55-ca3f-4172-9613-ae1ea51d7591 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:38.104277 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:38.148643 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858ca55-ca3f-4172-9613-ae1ea51d7591 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:38.153193 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:38.154056 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:38.154341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:38.154622 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] PATH_INFO: `/v3/users/6a653f8445f043f8b3375a9b1d8bf282` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:38.155827 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a653f8445f043f8b3375a9b1d8bf282)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:38.157784 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:38.203055 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a653f8445f043f8b3375a9b1d8bf282'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.214836 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a653f8445f043f8b3375a9b1d8bf282'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.222091 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a653f8445f043f8b3375a9b1d8bf282'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.229131 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a653f8445f043f8b3375a9b1d8bf282'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.229766 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a653f8445f043f8b3375a9b1d8bf282'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.235575 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1476/2931] 10.222.0.45 () {58 vars in 1223 bytes} [Thu Jul 21 05:58:38 2022] DELETE /identity/v3/users/6a653f8445f043f8b3375a9b1d8bf282 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:58:38.240557 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:38.241077 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:38.241183 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:38.259253 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] MFA Rules not processed for user `76d529df90494c78a07e9c839c744d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:58:38.260516 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:38.318277 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1456/2932] 10.222.0.45 () {58 vars in 957 bytes} [Thu Jul 21 05:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:58:38.327828 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:38.329260 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:38.386689 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4079ec-f3df-4df1-8c11-29f3d1d8ba67 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:38.390341 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:38.390982 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:38.391272 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:38.391556 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:38.401045 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:38.402478 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:38.412492 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1477/2933] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 05:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:58:38.676507 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:58:38.678007 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:58:38.690156 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3afb-7523-4400-9299-2fb4bcae0eca None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:58:38.695323 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d529df90494c78a07e9c839c744d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d6dae06458e40f5a42cb100a613e196', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:58:38.696187 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:58:38.696505 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:58:38.696788 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] PATH_INFO: `/v3/projects/bc1dfe4964ca400c96d5d77551fc76d8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:58:38.698025 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1dfe4964ca400c96d5d77551fc76d8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:58:38.700052 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:58:38.750275 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1dfe4964ca400c96d5d77551fc76d8', 'request_id': 'req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.757620 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1dfe4964ca400c96d5d77551fc76d8', 'request_id': 'req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.764976 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1dfe4964ca400c96d5d77551fc76d8', 'request_id': 'req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.774977 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] The token cache is being invalidate because project bc1dfe4964ca400c96d5d77551fc76d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:58:38.775273 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.775879 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:58:38.777432 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1457/2934] 10.222.0.45 () {58 vars in 1232 bytes} [Thu Jul 21 05:58:38 2022] DELETE /identity/v3/projects/bc1dfe4964ca400c96d5d77551fc76d8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:58:48.407637 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:48.772034 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:00:59.387128 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 06:00:59.388505 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 06:00:59.474015 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc243425-df29-4fb3-a8f1-cf2b3a105563 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 06:00:59.531265 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ca67c-bedf-414d-8e45-dfe4d0cb5106 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357f08257be47b58cf048c12daabfad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 06:00:59.531699 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca67c-bedf-414d-8e45-dfe4d0cb5106 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 06:00:59.531987 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca67c-bedf-414d-8e45-dfe4d0cb5106 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 06:00:59.532264 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca67c-bedf-414d-8e45-dfe4d0cb5106 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 06:00:59.534212 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b01ca67c-bedf-414d-8e45-dfe4d0cb5106 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 06:00:59.546413 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ca67c-bedf-414d-8e45-dfe4d0cb5106 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 06:00:59.547995 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ca67c-bedf-414d-8e45-dfe4d0cb5106 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 06:00:59.557954 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1478/2935] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 06:00:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 06:01:09.553660 dv-cinder-822822-6-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=65 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:02:36.145022 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 06:02:36.146474 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 06:02:36.213563 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc7f64-a564-47ef-9f8f-3c5ba4b8f566 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 06:02:36.217210 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0a528-815c-46ff-a6f0-95c595f2c70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7456efd79db1474fa9f0b392d9c7e4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62a6a9eed4b241179bff501834eba63f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 06:02:36.217846 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0a528-815c-46ff-a6f0-95c595f2c70f service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 06:02:36.218130 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0a528-815c-46ff-a6f0-95c595f2c70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 06:02:36.218410 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0a528-815c-46ff-a6f0-95c595f2c70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 06:02:36.220173 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-95c0a528-815c-46ff-a6f0-95c595f2c70f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 06:02:36.229453 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0a528-815c-46ff-a6f0-95c595f2c70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 06:02:36.230876 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0a528-815c-46ff-a6f0-95c595f2c70f service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 06:02:36.238617 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1458/2936] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Jul 21 06:02:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 06:02:46.235174 dv-cinder-822822-6-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=30 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}